-- Logs begin at Sat 2022-09-10 20:01:13 UTC, end at Sat 2022-09-10 20:57:07 UTC. -- Sep 10 20:29:44.112523 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 10 20:29:44.123220 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 20:29:44 2022] *** Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: nodename: dv-osbrick-master-4-ceph Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: machine: x86_64 Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: clock source: unix Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: pcre jit disabled Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: detected number of CPU cores: 4 Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: current working directory: / Sep 10 20:29:44.125293 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: detected binary path: /usr/bin/uwsgi-core Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: your processes number limit is 47680 Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: your memory page size is 4096 bytes Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: detected max file descriptor number: 2048 Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: lock engine: pthread robust mutexes Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: thunder lock: enabled Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 10 20:29:44.125845 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 20:29:44.169421 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: Python main interpreter initialized at 0x5599211a09c0 Sep 10 20:29:44.169421 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: python threads support enabled Sep 10 20:29:44.169421 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: your server socket listen backlog is limited to 100 connections Sep 10 20:29:44.169421 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: your mercy for graceful operations on workers is 90 seconds Sep 10 20:29:44.169760 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 20:29:44.169835 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: *** Operational MODE: preforking *** Sep 10 20:29:44.170079 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: *** uWSGI is running in multiple interpreter mode *** Sep 10 20:29:44.170079 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: spawned uWSGI master process (pid: 88322) Sep 10 20:29:44.170278 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 10 20:29:44.171306 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: spawned uWSGI worker 1 (pid: 88336, cores: 1) Sep 10 20:29:44.171640 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: spawned uWSGI worker 2 (pid: 88337, cores: 1) Sep 10 20:29:44.172811 dv-osbrick-master-4-ceph devstack@keystone.service[88322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 20:29:48.788083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:29:48.788083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: from cryptography.utils import int_from_bytes Sep 10 20:29:48.788913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:29:48.788913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: from cryptography.utils import int_from_bytes Sep 10 20:29:48.789332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:29:48.789332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: from cryptography.utils import int_from_bytes Sep 10 20:29:48.789440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:29:48.789440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: from cryptography.utils import int_from_bytes Sep 10 20:29:48.840877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 20:29:48.841077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 20:29:48.841247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] command line args: [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 20:29:48.841338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 20:29:48.841482 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 20:29:48.841568 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 20:29:48.841679 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] command line args: [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 20:29:48.841759 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ================================================================================ {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 20:29:48.841928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] admin_token = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 20:29:48.842111 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ================================================================================ {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 20:29:48.842195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] config_dir = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842344 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] admin_token = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] config_source = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] config_dir = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842708 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] debug = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842792 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.842910 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] config_source = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] debug = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843287 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843355 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.843916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_config_append = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844423 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844629 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_config_append = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844723 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_dir = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.844963 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_file = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_dir = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_file = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845719 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.845881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846612 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846692 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846898 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.846973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847094 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847167 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847287 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847366 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847570 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.847922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848134 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848604 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848812 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] publish_errors = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848906 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.848987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] publish_errors = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849057 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849205 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849418 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849492 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849833 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.849920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850038 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850144 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] standard_threads = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] standard_threads = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850354 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850717 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850793 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.850895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] use_journal = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851039 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] use_journal = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851187 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] use_json = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] use_json = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851326 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] use_stderr = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851400 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] use_stderr = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] use_syslog = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] use_syslog = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851707 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:29:48.851893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.851999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852084 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852238 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852496 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.852847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853159 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853255 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853356 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853490 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853604 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853810 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.853956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854199 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854681 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.854925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855161 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855244 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.855960 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856135 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856213 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856469 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856623 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856700 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.856971 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857134 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857465 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857638 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857722 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857871 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.857949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858099 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858326 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858401 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.858864 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859262 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859489 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859564 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859794 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.859961 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860038 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860275 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860503 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860911 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.860998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861377 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861455 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861607 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861724 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.861912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862134 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862582 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862738 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.862964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863039 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863495 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863652 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863727 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.863962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864114 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864344 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864418 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.864915 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865169 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865288 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865372 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865524 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.865943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866109 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866420 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866574 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866659 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.866887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867516 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867591 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867750 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.867984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868062 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868239 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868583 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.868836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869487 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869563 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869803 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.869963 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870046 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870197 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870751 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.870977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871141 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.871918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872170 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872317 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872691 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872862 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.872994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873131 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873257 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.873961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874088 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874228 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874485 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874617 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.874883 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875138 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.875904 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876042 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876168 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876553 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876677 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.876908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877440 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.877990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.external = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.external = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878657 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878782 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.878909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879166 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.password = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.password = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] auth.token = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] auth.token = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879810 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.879935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880433 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880564 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880691 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.880952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881089 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881224 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881485 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881610 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881742 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881866 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.881992 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882252 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882631 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.882891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883026 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883150 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883401 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883525 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883784 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.883909 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.884034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.884648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.884773 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.884935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885063 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885197 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885832 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.885956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886080 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886204 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886585 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.886976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887112 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887362 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887612 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.887869 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888378 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.888912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889038 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889476 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889553 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889695 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889926 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.889996 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890142 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890639 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890716 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890788 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890859 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890928 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.890998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891356 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891424 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891572 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.891969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892128 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892485 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892557 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892707 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892871 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.892954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893167 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893313 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893688 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893777 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.893932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894253 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894410 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894497 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.894965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895109 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895201 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895337 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895431 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.895892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.896884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897023 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897723 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897800 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.897971 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898210 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898315 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898753 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.898978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.899127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.899206 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.899364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.899441 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.899600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.899677 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.900381 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.900471 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.900630 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.900709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.900897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.900977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901138 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901218 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901369 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901593 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.901926 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902136 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902368 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902515 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902593 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902758 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902835 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.902998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903708 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.903931 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904173 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904635 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904890 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.904969 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905123 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905201 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905444 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.905907 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906146 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906298 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906375 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906543 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906777 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.906855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907083 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907243 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907714 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907798 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.907941 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908024 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908174 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908253 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908656 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.908998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909229 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909401 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909714 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909870 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.909946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910107 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910449 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] role.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] role.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.910876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] role.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] role.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911736 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911813 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.911976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912219 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912303 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912459 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912536 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.912965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.913210 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.913439 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.913684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.913928 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.914171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.914416 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.914687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.914854 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.914948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915020 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915540 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915621 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915786 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.915986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.916064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.916255 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.916441 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.916521 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.916741 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917163 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917254 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917458 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917612 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.917923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.918089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.918175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.918407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.918556 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.918633 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.918866 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919098 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919315 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919561 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919780 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.919934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920020 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920252 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.920971 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921218 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921464 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.921954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.922221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.922401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.922655 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.922899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.923143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.923378 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.923497 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.923618 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.923764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.923850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.924316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.924316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.924624 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.925985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926136 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926267 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926415 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.connection = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.926936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.927004 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.927193 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.927262 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.927446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.927521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.927920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.928021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.928233 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.connection = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.928477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.928727 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.929035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.929281 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.929520 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.929922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.930917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.931480 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.931670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.931748 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.931920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.931998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932159 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932406 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932640 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.932987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.933147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.933224 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.933316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 20:29:48.935667 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.936110 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.936371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.936620 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:29:48.936851 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 20:29:48.963043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.963273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.963497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.969103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.969335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.969559 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.971962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:48.978710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.000178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.000408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.004671 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.004935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.053824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.054132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.102444 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.102677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.104265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.104495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.168714 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.168887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.168992 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169179 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169397 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169828 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.169909 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.192646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.192872 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.192961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193188 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193625 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193759 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193839 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.193969 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.194050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.194177 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.205240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.205840 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.218290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.218524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.218750 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.218916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219002 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219176 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219604 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.219957 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.220154 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 10 20:29:49.237061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.237268 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 10 20:29:49.237614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.237814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 10 20:29:49.238093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.238360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.238624 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.238887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.241431 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.241641 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 10 20:29:49.241982 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.242241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 10 20:29:49.242564 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.242839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.243111 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.243379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.248477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.248756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.249059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.249347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.254285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.254563 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.254831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.255113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.256961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.260374 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.260661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.260973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.261261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.261545 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.261808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.262077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.262352 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.262538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.262630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.262906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.263160 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.265443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.265731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.266014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.266297 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.266579 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.266839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.267108 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.267378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.267646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.267915 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.268181 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.286294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.287763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.288049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.291339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.292623 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.292818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.292936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.293104 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.294836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.299412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.299698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.299980 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.301370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.301659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.305745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.306024 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.306312 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.306666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.306759 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.306953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.307036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.307230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.307526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.307815 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.311061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.311367 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.311653 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.311935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.312217 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.312492 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.312773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.313092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.324278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.324557 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.328438 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.329416 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.329693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.331560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.331970 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.333569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.336187 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.336781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.337100 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.339978 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.341817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.343092 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.343395 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.343683 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.344097 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.344391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.344676 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.344966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.348148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.348444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.348727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.349043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.349329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.349604 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.360488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.360780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.361071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.361333 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.365309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.365599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.365865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.366128 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.368095 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.369782 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.371332 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.371612 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.372982 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.374290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.374487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.374571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.374850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.375147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.375429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.376014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.376291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.378913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.379208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.379475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.379765 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.380152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.387275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.387565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.387857 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.388140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.388431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.388712 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.389016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.391772 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.392057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.392340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.392627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.393028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.393311 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.393600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.405113 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.408120 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.409789 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.411035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.412462 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.412689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.413952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.414238 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.414541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.415619 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.417107 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.418571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.418853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.419253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.421113 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.422590 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.425489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.425574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.425795 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.426082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.426359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.427032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.429928 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.430324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.430617 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.430889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.434388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.434686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.434970 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.439974 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.440262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.440539 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.442784 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.443071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.443354 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.443633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.443917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.444200 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.444478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.444746 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.445057 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.445329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.445609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.445885 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.446153 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.446413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.449108 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 10 20:29:49.449390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.449682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.449959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.450236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.450507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.450777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.451043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.451320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.451595 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.451881 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.452143 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.452407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.452664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 10 20:29:49.480634 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5599211a09c0 pid: 88336 (default app) Sep 10 20:29:49.484028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001bf2c-b77a-4b18-80aa-e2dc46842cd6 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:29:49.484316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001bf2c-b77a-4b18-80aa-e2dc46842cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:29:49.484589 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001bf2c-b77a-4b18-80aa-e2dc46842cd6 None None] PATH_INFO: `/v3` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:29:49.486212 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5599211a09c0 pid: 88337 (default app) Sep 10 20:29:49.488689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sat Sep 10 20:29:49 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:29:56.750315 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:29:56.750854 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:29:56.750854 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:29:56.755099 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:29:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:29:56.760959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:29:56.761477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:29:56.761631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:29:56.838156 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: INFO dbcounter [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] Registered counter for database keystone Sep 10 20:29:56.857285 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG oslo_db.sqlalchemy.engines [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:29:56.863477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writer thread running {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:29:57.040399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG passlib.handlers.bcrypt [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88336) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 10 20:29:57.040738 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG passlib.handlers.bcrypt [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88336) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 10 20:29:57.099018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:29:57.100619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:29:57.232161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:29:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 10 20:29:57.716505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:29:57.805506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: INFO dbcounter [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] Registered counter for database keystone Sep 10 20:29:57.827477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:29:57.833602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writer thread running {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:29:57.950396 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5019b0-1238-4743-9719-dde8aaec0664 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:29:57.954638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:29:57.955247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:29:57.955523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:29:57.955792 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:29:57.964431 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:29:58.015892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 10 20:29:58.016236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ee797-bf69-483b-9297-97e41cec73bf admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:29:58.026548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 10 20:29:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 10 20:29:58.032401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:29:58.050714 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7043afc-a587-4dd2-b6c8-f33ad6085d72 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:29:58.055388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:29:58.056549 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:29:58.056853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:29:58.057646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] PATH_INFO: `/v3/projects/13b9411a439646919a95885e1ed2dcbc` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:29:58.061880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] RBAC: Authorizing `identity:get_project(project_id=13b9411a439646919a95885e1ed2dcbc)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:29:58.112674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 10 20:29:58.113040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94f2a9-64db-4f51-b4f4-8e419d15a18e admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:29:58.117586 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Sep 10 20:29:58 2022] GET /identity/v3/projects/13b9411a439646919a95885e1ed2dcbc => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:00.488291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d98f6-1858-4f90-a6cd-f2da85e4b8a2 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:00.488857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d98f6-1858-4f90-a6cd-f2da85e4b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:00.488857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d98f6-1858-4f90-a6cd-f2da85e4b8a2 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:00.492875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:00.498163 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:00.498612 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:00.498710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:00.518947 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:00.520442 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:00.528775 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 10 20:30:00.852005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d98f6-1858-4f90-a6cd-f2da85e4b8a2 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:00.864483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d98f6-1858-4f90-a6cd-f2da85e4b8a2 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:00.869253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaccfb-cab3-4973-b9f4-1b640325476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:00.869838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaccfb-cab3-4973-b9f4-1b640325476c admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:00.870116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaccfb-cab3-4973-b9f4-1b640325476c admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:00.870387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaccfb-cab3-4973-b9f4-1b640325476c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:00.877836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfaccfb-cab3-4973-b9f4-1b640325476c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:00.879604 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfaccfb-cab3-4973-b9f4-1b640325476c admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:00.888106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 10 20:30:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 10 20:30:00.893562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:00.903836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2277d23-943e-4735-b657-56fe881f15e6 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:00.908521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83983c8-cd9c-490f-834e-b2072fd38f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:00.909197 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83983c8-cd9c-490f-834e-b2072fd38f6a admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:00.909486 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83983c8-cd9c-490f-834e-b2072fd38f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:00.909765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83983c8-cd9c-490f-834e-b2072fd38f6a admin admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:00.911169 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83983c8-cd9c-490f-834e-b2072fd38f6a admin admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:00.913254 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83983c8-cd9c-490f-834e-b2072fd38f6a admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:00.915394 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sat Sep 10 20:30:00 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:03.369118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791818a9-95eb-4c5a-846f-a2c624e4c419 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:03.369657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791818a9-95eb-4c5a-846f-a2c624e4c419 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:03.369657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791818a9-95eb-4c5a-846f-a2c624e4c419 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:03.370987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:03.376136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:03.376563 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:03.376716 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:03.385681 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c8db0-fd1c-48a9-bd6a-c52f2ffeee0a None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:03.385967 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c8db0-fd1c-48a9-bd6a-c52f2ffeee0a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:03.386242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c8db0-fd1c-48a9-bd6a-c52f2ffeee0a None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:03.387516 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:03.392477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:03.392761 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:03.393058 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:03.394419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:03.395578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:03.437152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG passlib.handlers.bcrypt [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88337) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 10 20:30:03.437535 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG passlib.handlers.bcrypt [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88337) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 10 20:30:03.476924 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:03.487147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:03.488731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:03.585727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:03.803001 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:03.830643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:03.907794 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.009483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bbd80-c8ba-4278-b480-48fae2b97d01 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.011704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:04.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0847998-b1a5-4e72-a871-d51bb0b8f700 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.046721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.047562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.047842 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.048116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.054662 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.055806 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.056098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.056370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.068191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:04.078019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:04.078877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:04.079690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:04.085059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.114807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.116334 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.163744 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:04.182432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4b8cf-137b-4d24-b2c7-7d845ebe937a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.213480 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 10 20:30:04.219027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.219163 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.219633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.219913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.220185 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.220876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:04.221176 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.221668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:04.222555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.234986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:04.240617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.313823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4b468-661e-4b81-a265-4a3851b634ea None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.338383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11004a-f932-482e-92a2-0f3efc0a3b8b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.347388 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.348229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.348508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.348778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.368284 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.369811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.375519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.376158 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.376652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.376734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.377883 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.379333 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.380950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:04 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:04.386403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:30:04.390084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:04.391091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:30:04.391903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:30:04.391903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:30:04.391903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:04.391903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:30:04.396966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.403035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:04.500058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371af761-43fb-4762-b28f-f1dce6cc628d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.534863 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.535490 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.535772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.536043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.537179 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.538629 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.540355 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:04.546304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:04.562450 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:04.606803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08908b8-ce54-448e-8eeb-79ea61b509da None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.624422 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:04.638950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.639556 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.639835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.640109 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.640748 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:04.641081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.642474 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd6da3-8098-4269-a462-7c717fa5cdf0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.643968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5e5af-70e4-4f10-8c9b-c6dd856c1daf None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:04.660157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:04.686363 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:04.687024 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:04.687521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:04.688012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:04.689022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.domain.id=default, user.id=4896c73f97d94602afe7ed8c9d748471) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:04.689334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:04.691168 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cab75-fd64-4fe1-b15d-5d20179d9222 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:04.701620 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Sep 10 20:30:04 2022] GET /identity/v3/role_assignments?user.id=4896c73f97d94602afe7ed8c9d748471&scope.domain.id=default&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:07.468060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8625f-2a70-4225-9de0-8d50cfc04dbf None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:07.469150 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8625f-2a70-4225-9de0-8d50cfc04dbf None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:07.469631 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8625f-2a70-4225-9de0-8d50cfc04dbf None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:07.471175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:07.477472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf30c-358f-46a9-8179-3352dcf69714 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:07.478304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf30c-358f-46a9-8179-3352dcf69714 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:07.478787 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf30c-358f-46a9-8179-3352dcf69714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:07.506340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-c67cf30c-358f-46a9-8179-3352dcf69714 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:07.507906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-c67cf30c-358f-46a9-8179-3352dcf69714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:07.602726 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:07.648103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb5aff-3390-4590-9ee3-0232ec730526 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:07.649266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb5aff-3390-4590-9ee3-0232ec730526 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:07.649771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb5aff-3390-4590-9ee3-0232ec730526 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:07.651338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:07.656482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b0d6-eae2-4f7d-ac6b-f0551264aba1 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:07.657020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b0d6-eae2-4f7d-ac6b-f0551264aba1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:07.657505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b0d6-eae2-4f7d-ac6b-f0551264aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:07.685827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-2fe9b0d6-eae2-4f7d-ac6b-f0551264aba1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:07.687399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-2fe9b0d6-eae2-4f7d-ac6b-f0551264aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:07.775719 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:07.788156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a209f0a-1194-4f63-acfd-127da510ce3e None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:07.788757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a209f0a-1194-4f63-acfd-127da510ce3e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:07.789312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a209f0a-1194-4f63-acfd-127da510ce3e None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:07.791113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:07.798186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:07.798477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:07.798754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:07.809513 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:07.823184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:07.825060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:07.922351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:08.150930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a209f0a-1194-4f63-acfd-127da510ce3e None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:08.293347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a209f0a-1194-4f63-acfd-127da510ce3e None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:08.314490 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:08.338037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:08.338670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:08.338952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:08.339229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:08.359502 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:08.365925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:08.366756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:08.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:08.368666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:08.373240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:08.387660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:08.553666 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c6589-c222-41b5-a30a-03d9aabb6671 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:08.569939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e682e-4c45-467d-9895-dc3ccdef82da None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:08.627321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:08.629302 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:08.629756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:08.631099 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:08.631914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:08.633048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:08.636254 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:08.639157 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:08.640761 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:08.642422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:08.645332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:08.646279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:08.652216 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:08.653348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:08.668936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:08.670771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:30:08.698626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:08.699657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:30:08.700452 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:30:08.700452 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:30:08.700452 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:08.714253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:08.715541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:08.768127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:08.833592 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5233-93c3-4976-af56-9f75d1e7c172 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:08.864882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00f59-940c-49a6-ab93-ceba68687354 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:08.885495 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d356f-2b49-4e3a-89e0-8878a7db2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:08.886333 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d356f-2b49-4e3a-89e0-8878a7db2fad None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:08.886711 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d356f-2b49-4e3a-89e0-8878a7db2fad None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:08.887131 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d356f-2b49-4e3a-89e0-8878a7db2fad None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:08.888026 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d356f-2b49-4e3a-89e0-8878a7db2fad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:08.889920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d356f-2b49-4e3a-89e0-8878a7db2fad None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:08.909028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:08.909891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:08.910369 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:08.910814 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:08.912428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:08.914065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:08.916634 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:08 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:08.917764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:09.029158 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:09.035863 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91313904-ca85-4bf0-9568-0e6b36f22fb2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:09.048735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 16/32] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 10 20:30:08 2022] POST /identity/v3/roles => generated 219 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:09.050654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d769-a4ec-4256-8b43-878c0b7faec3 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.051103 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d769-a4ec-4256-8b43-878c0b7faec3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.051456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d769-a4ec-4256-8b43-878c0b7faec3 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.053280 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:09.054017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340d769-a4ec-4256-8b43-878c0b7faec3 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:09.076213 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:09.077208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.077670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.077945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.078589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:09.078892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:09.080303 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596021-9fcd-49dd-8f65-cd8e6d28e614 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:09.100874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:09.100874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.100874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.100874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.122869 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:09.124062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:09.180211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:09.222694 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 18/35] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:09.223241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:09.239054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340d769-a4ec-4256-8b43-878c0b7faec3 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:09.281659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a9ff-ec40-47b2-9c27-3458498b66fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:09.282796 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a9ff-ec40-47b2-9c27-3458498b66fc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.283294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a9ff-ec40-47b2-9c27-3458498b66fc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.283761 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a9ff-ec40-47b2-9c27-3458498b66fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.285421 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a9ff-ec40-47b2-9c27-3458498b66fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:09.287354 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a9ff-ec40-47b2-9c27-3458498b66fc None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:09.289501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 18/36] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:09.290874 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3be7f-2f94-4f2d-b38e-321fabf7810a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.291495 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3be7f-2f94-4f2d-b38e-321fabf7810a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.291984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3be7f-2f94-4f2d-b38e-321fabf7810a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.293571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 19/37] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:09.298801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3be7f-2f94-4f2d-b38e-321fabf7810a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:09.316699 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:09.332599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685fea-6fc0-4ffe-8f85-123f1cb196d4 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:09.372689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83039a1-d20c-4759-b338-03707c73f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:09.373422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83039a1-d20c-4759-b338-03707c73f28c None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.373545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83039a1-d20c-4759-b338-03707c73f28c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.373795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83039a1-d20c-4759-b338-03707c73f28c None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.374433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83039a1-d20c-4759-b338-03707c73f28c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:09.375869 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83039a1-d20c-4759-b338-03707c73f28c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:09.426965 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3be7f-2f94-4f2d-b38e-321fabf7810a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:09.453802 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:09.467043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729e0cd-6987-4701-9ab3-1084409146a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:09.467975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e0cd-6987-4701-9ab3-1084409146a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.468445 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e0cd-6987-4701-9ab3-1084409146a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.469005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e0cd-6987-4701-9ab3-1084409146a8 None admin] PATH_INFO: `/v3/domains/default/users/4896c73f97d94602afe7ed8c9d748471/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.471272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729e0cd-6987-4701-9ab3-1084409146a8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4896c73f97d94602afe7ed8c9d748471, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:09.472933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729e0cd-6987-4701-9ab3-1084409146a8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:09.487629 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Sep 10 20:30:09 2022] PUT /identity/v3/domains/default/users/4896c73f97d94602afe7ed8c9d748471/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:09.489128 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.489631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.490147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.511160 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:09.513175 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:09.520490 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:30:09 2022] POST /identity/v3/projects => generated 301 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:09.522057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06313b44-edb8-4464-83e0-46981798ad4c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.522344 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06313b44-edb8-4464-83e0-46981798ad4c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.522618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06313b44-edb8-4464-83e0-46981798ad4c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.523911 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:09.529709 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.530151 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.530525 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.552846 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:09.554718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:09.610847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:09.618446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:09.660520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:09.742040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e446d-6b5a-4102-946f-ddde8862367b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:09.758948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:09.782643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:09.783270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:09.783555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:09.783826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:09.784494 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:09.785958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:09.811927 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 10 20:30:09 2022] POST /identity/v3/roles => generated 225 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:30:09.986656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:10.007071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:10.077103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:10.123858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca02f37-a5fa-4b55-ad24-9229925ce5e5 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:10.158872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6871a80-cc2a-492d-83b9-c65b6ef7fd4c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:10.171045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:10.172308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:10.172308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:10.172308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:10.172989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:10.174422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:10.196214 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 10 20:30:09 2022] POST /identity/v3/roles => generated 223 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:10.204479 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba88b7b-98ec-4904-b006-e0de1fe0e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:10.205281 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba88b7b-98ec-4904-b006-e0de1fe0e8a2 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:10.205570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba88b7b-98ec-4904-b006-e0de1fe0e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:10.205846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba88b7b-98ec-4904-b006-e0de1fe0e8a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:10.207077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba88b7b-98ec-4904-b006-e0de1fe0e8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:10.208584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba88b7b-98ec-4904-b006-e0de1fe0e8a2 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:10.210322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:10.216935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:10.326232 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a675-e003-4d8d-90b0-bf2e04620e14 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:10.354238 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:10.363992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6a10-9870-45ab-a3b2-94064a089032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:10.364614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6a10-9870-45ab-a3b2-94064a089032 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:10.364933 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6a10-9870-45ab-a3b2-94064a089032 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:10.365215 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6a10-9870-45ab-a3b2-94064a089032 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:10.365866 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6a10-9870-45ab-a3b2-94064a089032 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:10.367947 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6a10-9870-45ab-a3b2-94064a089032 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:10.396575 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:30:10 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:12.071454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8476-3943-4ece-b2c2-ff111e75c195 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.071948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8476-3943-4ece-b2c2-ff111e75c195 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.072304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8476-3943-4ece-b2c2-ff111e75c195 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.073600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:12.078705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.079075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.079335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.097681 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:12.098873 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:12.163884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:12.483162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8476-3943-4ece-b2c2-ff111e75c195 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:12.527429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:12.584633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8476-3943-4ece-b2c2-ff111e75c195 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:12.616908 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece36a-b98d-4074-8f36-82cc3bc89597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:12.617614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece36a-b98d-4074-8f36-82cc3bc89597 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.617897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece36a-b98d-4074-8f36-82cc3bc89597 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.618172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece36a-b98d-4074-8f36-82cc3bc89597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.628420 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece36a-b98d-4074-8f36-82cc3bc89597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-22ece36a-b98d-4074-8f36-82cc3bc89597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:12.633822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:12.634877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:12.637633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:12.640689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:12.738743 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7883-c7ca-4431-b25c-58360b93d550 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:12.750004 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:12.775259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:12.775868 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.776149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.776422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.777126 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:12.777431 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:12.778812 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:12.785353 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064e01-a5ec-424b-8fe9-7832bd956214 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.785638 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064e01-a5ec-424b-8fe9-7832bd956214 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.785913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064e01-a5ec-424b-8fe9-7832bd956214 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.787248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 26/50] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:12.790443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:12.792431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.792779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.793156 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.795892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:12.810702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:12.811901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:12.877621 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:12.891395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cace19-7588-4e53-a304-6fdb991b2e33 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:12.926426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:12.927336 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:12.927763 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:12.928176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:12.930385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:12.932716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:12.935289 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:12 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:12.940687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:12.971132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:13.039683 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae518-86b0-49d7-833b-1b245febbc3b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:13.072639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:13.073284 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:13.073561 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:13.073833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:13.074924 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:13.076373 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:13.078163 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:13.083655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:13.128468 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:13.184703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ee3e-26de-48b2-be36-05a3c68cac93 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:13.203633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:13.216856 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:13.217457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:13.217746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:13.218005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:13.218715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.domain.id=default, user.id=4896c73f97d94602afe7ed8c9d748471) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:13.219026 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:13.220486 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:13.230086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Sep 10 20:30:13 2022] GET /identity/v3/role_assignments?user.id=4896c73f97d94602afe7ed8c9d748471&scope.domain.id=default&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:13.308089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:13.311540 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfd11d-8e7b-4bbf-957e-9e6cfd241458 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:13.349973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1551bf-f026-42a0-bc18-e22e4c5259db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:13.350615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1551bf-f026-42a0-bc18-e22e4c5259db None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:13.350901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1551bf-f026-42a0-bc18-e22e4c5259db None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:13.351179 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1551bf-f026-42a0-bc18-e22e4c5259db None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:13.352315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1551bf-f026-42a0-bc18-e22e4c5259db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:13.353831 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1551bf-f026-42a0-bc18-e22e4c5259db None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:13.355643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:13.361208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:13.463696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f877b3-dc57-4525-9fbf-af7ad7859a78 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:13.466005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:13.498413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240776b-1c31-444b-8553-3487862dde27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:13.499025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240776b-1c31-444b-8553-3487862dde27 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:13.499310 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240776b-1c31-444b-8553-3487862dde27 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:13.499588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240776b-1c31-444b-8553-3487862dde27 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:13.500236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240776b-1c31-444b-8553-3487862dde27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:13.501729 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240776b-1c31-444b-8553-3487862dde27 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:13.526976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Sep 10 20:30:13 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:15.903778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd80413-8aa0-47d4-9763-f61ddf171e9a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:15.904298 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd80413-8aa0-47d4-9763-f61ddf171e9a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:15.904407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd80413-8aa0-47d4-9763-f61ddf171e9a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:15.905694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:15.910988 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:15.911402 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:15.911602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:15.932509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:15.933750 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:15.998089 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:16.323761 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd80413-8aa0-47d4-9763-f61ddf171e9a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:16.421001 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd80413-8aa0-47d4-9763-f61ddf171e9a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:16.453602 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd8999-5e20-432b-9afa-8ae19058cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:16.454208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd8999-5e20-432b-9afa-8ae19058cb43 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:16.454488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd8999-5e20-432b-9afa-8ae19058cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:16.454759 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd8999-5e20-432b-9afa-8ae19058cb43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:16.455847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd8999-5e20-432b-9afa-8ae19058cb43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:16.457314 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd8999-5e20-432b-9afa-8ae19058cb43 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:16.458838 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:16.464709 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:16.549235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:16.565313 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7cb0a-3c65-4d8d-9278-0e7835a68412 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:16.598030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf8d8-1c6a-45e6-8cb4-ef1aff8e9c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:16.598626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf8d8-1c6a-45e6-8cb4-ef1aff8e9c99 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:16.598905 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf8d8-1c6a-45e6-8cb4-ef1aff8e9c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:16.599175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf8d8-1c6a-45e6-8cb4-ef1aff8e9c99 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:16.599824 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf8d8-1c6a-45e6-8cb4-ef1aff8e9c99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:16.601802 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf8d8-1c6a-45e6-8cb4-ef1aff8e9c99 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:16.627287 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:16 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:30:20.126360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969554-e4c2-42fe-b073-ea1d1a7c52dc None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.127345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969554-e4c2-42fe-b073-ea1d1a7c52dc None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.127818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969554-e4c2-42fe-b073-ea1d1a7c52dc None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.129391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:20.135600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dfe5f-419a-45a0-b19d-59149ca8ea5d None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.136465 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dfe5f-419a-45a0-b19d-59149ca8ea5d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.136973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dfe5f-419a-45a0-b19d-59149ca8ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.156602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-885dfe5f-419a-45a0-b19d-59149ca8ea5d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:20.157852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-885dfe5f-419a-45a0-b19d-59149ca8ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:20.243908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:20.326709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ed9c-f407-4ade-bded-949191bdd8bb None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.327378 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ed9c-f407-4ade-bded-949191bdd8bb None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.327853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ed9c-f407-4ade-bded-949191bdd8bb None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.329412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:20.335057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade15c5-10b5-4db4-83c1-2cbf3b8a505a None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.335353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade15c5-10b5-4db4-83c1-2cbf3b8a505a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.335665 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade15c5-10b5-4db4-83c1-2cbf3b8a505a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.361813 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-aade15c5-10b5-4db4-83c1-2cbf3b8a505a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:20.363088 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-aade15c5-10b5-4db4-83c1-2cbf3b8a505a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:20.448079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:20.604634 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0724b0-ae65-4346-a2c6-f64e1e49b180 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.605303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0724b0-ae65-4346-a2c6-f64e1e49b180 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.605781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0724b0-ae65-4346-a2c6-f64e1e49b180 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.607329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 34/66] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:20.612866 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102316-1902-4595-b756-f2f11ed9667f None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.613421 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102316-1902-4595-b756-f2f11ed9667f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.613920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102316-1902-4595-b756-f2f11ed9667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.624598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:20.640970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f0102316-1902-4595-b756-f2f11ed9667f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:20.642180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f0102316-1902-4595-b756-f2f11ed9667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:20.709764 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0724b0-ae65-4346-a2c6-f64e1e49b180 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:20.727534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 33/67] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:20.781815 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:20.873489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0724b0-ae65-4346-a2c6-f64e1e49b180 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:20.882847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c776a7-e7d6-421e-88af-ad5e8423d2be None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.883410 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c776a7-e7d6-421e-88af-ad5e8423d2be None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.883910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c776a7-e7d6-421e-88af-ad5e8423d2be None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.885586 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 34/68] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:20.891056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.891562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.892037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.914044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:20.915602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:20.922047 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:20.922679 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:20.922962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:20.923235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:20.934192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:20.939771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:20.940617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:20.941693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:20.942324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.003090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 35/70] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:21.008862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.073970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.101748 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.105419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f4391-ca94-4581-8728-62f26f703990 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.124695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8b52a-884c-4492-824e-2ee1779dc4bf None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.143147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.144360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.144809 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.145228 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.161212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:21.165972 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.166589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.166888 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.167166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.167833 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:21.168141 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.169566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fada50-0cd0-4ca7-a1b6-00931930c7eb None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:21.174060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:21.174906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:21.176045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.181331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:21.182717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd33608-6e05-4a7a-b740-6170a5ff7194 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.183009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd33608-6e05-4a7a-b740-6170a5ff7194 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.183290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd33608-6e05-4a7a-b740-6170a5ff7194 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.184493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 37/73] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:21.185420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd33608-6e05-4a7a-b740-6170a5ff7194 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.296120 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd33608-6e05-4a7a-b740-6170a5ff7194 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.316396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79e85-beb4-46a2-b81c-accd05c5beea None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.321333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.334698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.335310 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.335672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.335908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.336567 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:21.337322 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.338886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.347359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:21.348409 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.356173 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897ef4-1a97-4b9d-8d84-b81838c0a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.356873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897ef4-1a97-4b9d-8d84-b81838c0a49c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.357162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897ef4-1a97-4b9d-8d84-b81838c0a49c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.357438 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897ef4-1a97-4b9d-8d84-b81838c0a49c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.370234 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc897ef4-1a97-4b9d-8d84-b81838c0a49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-bc897ef4-1a97-4b9d-8d84-b81838c0a49c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:21.375149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:21.375998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:21.376763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:21.377781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.377781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.377891 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.395756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:21.396984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:21.407639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.453790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dccb2-37e6-471e-83bc-be9610d397e1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.462203 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 38/76] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:21.463020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.486656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.487280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.487562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.487836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.503904 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.505398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.507171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:21.509650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.557431 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.581895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f7805-27ac-47aa-85d4-27eb296277e4 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.619493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432df02c-1567-41d0-b5f4-3f45992029f4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.622735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.623384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.623663 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.623937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.625138 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.626799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.629833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:21.630850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.648019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.662472 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.663324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.664320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.664594 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.675773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:21.680670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:21.681621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:21.682398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:21.683013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.744431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0e34-19e1-4e21-a92a-41ed7f564c4c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.781180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.781873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.782159 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.782432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.783080 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:21.783383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.784749 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.791250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d3b2b-23b0-433c-a77b-fdf9b1418629 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.792937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:21.793798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:21.795083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.827603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.828209 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.828490 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.828765 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.869114 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:21.892022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8db5f-d5dc-42fd-9ea8-bea6ad128546 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:21.895373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.896889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.925083 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:21.925702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:21.925984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:21.926261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:21.996323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:21.997873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:21.998930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 41/81] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:21.999779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.002822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.073777 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.097283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:22.097987 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.099560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffcd09-ac3a-4709-9db9-e958f59804b6 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.138441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.139050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.139336 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.139614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.140271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:22.140578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.142087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.150456 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.151258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.202566 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fde5d-cc8e-4630-a3f3-95213d805000 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.216930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.237225 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.237855 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.238145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.238419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.239533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.241025 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.243133 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.247961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.253528 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b4966-fe61-4cc2-8579-69f315432914 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.285203 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.285820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.286096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.286365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.287488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.289461 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.289942 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.291035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.292096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.344496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1458f1-2e7f-4148-9cb7-58535da5a4dc None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.377723 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.378347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.378628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.378902 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.380106 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.381488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.383117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.383934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.388164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339d4f-5d80-4123-80e7-84959f0c8e76 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.421999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.422552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.422830 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.423499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.424603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.426067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.427669 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.428421 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.435235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.482860 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a782a-47a2-42d7-83a6-cf6fccb8f200 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.495846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.517048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.517668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.517951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.518226 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.519338 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.520918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.522630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.523817 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.535434 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21743a38-3732-4a21-ae98-7008e0010366 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.568871 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.570303 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.570744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.571025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.571674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.573428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.595886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 45/89] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:22 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:22.596704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.631592 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53704d65-b677-4755-9fcb-a0f77e6b8f5a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.674397 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.675090 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.675380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.676010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.677852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.725722 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a204b-9a43-49b3-b38f-b3b16953e1d4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.734164 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:22.758646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.760158 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.763386 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:22.764015 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:22.764298 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:22.764575 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:22.765359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=95ed238335d547508b979f5f80415d9b) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:22.765673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:22.767179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:22.774049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/role_assignments?user.id=95ed238335d547508b979f5f80415d9b&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:22.774920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.917678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 45/91] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:22.918202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:22.938187 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43db9-f0c7-425c-8195-b1ab4be2563c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:22.974916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:23.002579 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:23.003206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:23.003491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:23.003770 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:23.004504 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=4896c73f97d94602afe7ed8c9d748471) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:23.004846 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:23.006442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:23.014216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/role_assignments?user.id=4896c73f97d94602afe7ed8c9d748471&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:23.014980 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:23.030648 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:23.057399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570cf5c-37db-4506-8d2d-d2028ea35178 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:23.111599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:23.112238 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:23.112517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:23.112818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:23.168329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e64c-87ef-4466-bfde-4433924e5b99 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:23.217029 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:23.218539 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:23.219184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:23.219477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:23.219736 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:23.220655 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:23.220934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:23.222375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:23.224317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:23 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:23.230885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:23.333165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:23.368132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:23.400818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 46/94] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:23.404513 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:23.425211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0089e0-9550-4d1b-b059-190f45452e69 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:23.491887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:23.492974 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:23.494435 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:23.494909 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:23.495990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] RBAC: Adding query filter params (role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=95ed238335d547508b979f5f80415d9b) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:23.497601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:23.499331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:23.508286 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 49/95] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:23 2022] GET /identity/v3/role_assignments?user.id=95ed238335d547508b979f5f80415d9b&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:23.558725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f650806-1198-442c-83a1-5d4f9d67d2a9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:23.613502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00978af-3d5e-482f-b9a3-af52393c5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:23.614482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00978af-3d5e-482f-b9a3-af52393c5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:23.614984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00978af-3d5e-482f-b9a3-af52393c5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:23.615519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00978af-3d5e-482f-b9a3-af52393c5ef2 None admin] PATH_INFO: `/v3/projects/3e5538d030614859b996b27ec15ee9e7` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:23.617428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00978af-3d5e-482f-b9a3-af52393c5ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e5538d030614859b996b27ec15ee9e7)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:23.619093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00978af-3d5e-482f-b9a3-af52393c5ef2 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:23.621040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:23 2022] GET /identity/v3/projects/3e5538d030614859b996b27ec15ee9e7 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:23.627380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:23.739144 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5b8d3-8b30-4938-8930-378195d1df5d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:23.776057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:23.777119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:23.777603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:23.778104 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:23.779049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=3e5538d030614859b996b27ec15ee9e7, user.id=95ed238335d547508b979f5f80415d9b) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:23.779561 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:23.781285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609defa-f89d-498a-9a3a-9c3dc181d997 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:23.783530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:23.788018 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:23 2022] GET /identity/v3/role_assignments?user.id=95ed238335d547508b979f5f80415d9b&scope.project.id=3e5538d030614859b996b27ec15ee9e7&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:25.778437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb57e2f-e62a-4597-ae6a-34f29ba82ac2 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:25.779441 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb57e2f-e62a-4597-ae6a-34f29ba82ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:25.779921 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb57e2f-e62a-4597-ae6a-34f29ba82ac2 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:25.781770 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:25.786792 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67188-fb35-45cc-8e0e-630b165766f6 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:25.787588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67188-fb35-45cc-8e0e-630b165766f6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:25.788109 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67188-fb35-45cc-8e0e-630b165766f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:25.807500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-7df67188-fb35-45cc-8e0e-630b165766f6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:25.813195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-7df67188-fb35-45cc-8e0e-630b165766f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:25.904164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 51/99] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:26.344879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb57e2f-e62a-4597-ae6a-34f29ba82ac2 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:26.407872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:26.450718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047f2e-67c2-496d-9fee-c02e771b07b4 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.451113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047f2e-67c2-496d-9fee-c02e771b07b4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.451406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047f2e-67c2-496d-9fee-c02e771b07b4 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.453009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 52/100] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:26.462349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df6a51-43a0-4448-8fb5-d2c28cc41318 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.462910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df6a51-43a0-4448-8fb5-d2c28cc41318 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.463427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df6a51-43a0-4448-8fb5-d2c28cc41318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.471523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb57e2f-e62a-4597-ae6a-34f29ba82ac2 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:26.505781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-04df6a51-43a0-4448-8fb5-d2c28cc41318 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:26.507879 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-04df6a51-43a0-4448-8fb5-d2c28cc41318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:26.513098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:26.513730 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.514010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.514278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.534031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:26.539054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:26.540734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:26.541740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 49/101] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:26.555557 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:26.667136 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 53/102] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:26.674057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048050-2c5e-404d-ae00-bdad85903643 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.674613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048050-2c5e-404d-ae00-bdad85903643 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.675086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048050-2c5e-404d-ae00-bdad85903643 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.676578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 54/103] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:26.681873 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.682388 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.682898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.714494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:26.717900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:26.732831 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db643-66f4-44be-bca2-0332186b2609 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:26.750579 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:26.772438 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:26.773596 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.774177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.774657 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.775533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:26.776086 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:26.778117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:26.787402 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 50/104] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:26.794198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:26.796706 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:26.845941 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 55/105] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:26.936934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127ce0-6553-489d-9655-5ea319c69d02 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:26.994964 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b28671-592a-4fdf-8c76-83bea1d25ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:26.995611 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b28671-592a-4fdf-8c76-83bea1d25ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:26.995898 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b28671-592a-4fdf-8c76-83bea1d25ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:26.996278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b28671-592a-4fdf-8c76-83bea1d25ae6 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:26.997488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b28671-592a-4fdf-8c76-83bea1d25ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:26.999015 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b28671-592a-4fdf-8c76-83bea1d25ae6 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:27.000620 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 51/106] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:26 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:27.006762 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.007686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c5df7-9b07-4645-89e4-60947bc2667c None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.008083 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c5df7-9b07-4645-89e4-60947bc2667c None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.008366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c5df7-9b07-4645-89e4-60947bc2667c None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.017968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 52/107] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:27.023672 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.023958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.024230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.061951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:27.063552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:27.141689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:27.199472 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1c06c-9b4a-4665-b292-d1f88e68ddf0 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.240310 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:27.278393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.279024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.279305 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.279577 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.285478 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:27.286921 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:27.288601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 56/109] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:27 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:27.291560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.294172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.368784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:27.439613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6ed7-eaae-4f3d-9418-0a78f6420095 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.442282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cb5c5-0f21-493c-88b9-00dae83edacb None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.482154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.482499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758d6c9-470b-4843-a9e0-efff2d8b9d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.482960 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.483338 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.483694 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d6c9-470b-4843-a9e0-efff2d8b9d78 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.483799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.484191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d6c9-470b-4843-a9e0-efff2d8b9d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.484869 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d6c9-470b-4843-a9e0-efff2d8b9d78 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/95ed238335d547508b979f5f80415d9b/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.486974 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758d6c9-470b-4843-a9e0-efff2d8b9d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a25fef9086f400895e3834cc2bc7398, user_id=95ed238335d547508b979f5f80415d9b, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:27.488651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758d6c9-470b-4843-a9e0-efff2d8b9d78 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:27.496636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:27.501943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:27.503010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 54/110] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:30:27.508958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.513598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:27 2022] PUT /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/95ed238335d547508b979f5f80415d9b/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 10 20:30:27.515130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c89b-8258-40db-853e-3298bca671ef None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.515626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c89b-8258-40db-853e-3298bca671ef None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.516044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c89b-8258-40db-853e-3298bca671ef None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.517622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 58/112] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:27.518584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86c89b-8258-40db-853e-3298bca671ef None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.562551 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:27.634129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:27.638684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86c89b-8258-40db-853e-3298bca671ef None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.682596 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.683226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.683513 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.683791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.684465 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:27.684773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:27.686240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cfb4f-df78-4540-9f5e-8a5a444a4a77 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:27.695774 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751124a6-88c0-4872-a6e2-2edcdad28973 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.697484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 59/113] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:27.702105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d563678-7663-4a57-a72a-2e011c377d28 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.702586 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d563678-7663-4a57-a72a-2e011c377d28 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.702872 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d563678-7663-4a57-a72a-2e011c377d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.723858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-8d563678-7663-4a57-a72a-2e011c377d28 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:27.725307 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-8d563678-7663-4a57-a72a-2e011c377d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:27.738248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.738899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.739266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.739614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.740912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:27.742517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:27.744289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 55/114] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:27.750009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.803281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 60/115] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:27.805195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024495-bfd8-49f4-a52c-0f4dffa4e6ee None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.805646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024495-bfd8-49f4-a52c-0f4dffa4e6ee None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.806063 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024495-bfd8-49f4-a52c-0f4dffa4e6ee None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.808546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 61/116] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:27.809494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024495-bfd8-49f4-a52c-0f4dffa4e6ee None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.860752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:27.867563 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1292-45b2-4d2a-a7c9-1c4bc86b3da9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.907908 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.909191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.909619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.910058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.923678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:27.925265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:27.930952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:27.931975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:27.933027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:27.935256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 56/117] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:27.937096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:27.942283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024495-bfd8-49f4-a52c-0f4dffa4e6ee None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:27.994546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7091b-906d-4d8b-9cc9-ae71a674e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:27.995276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7091b-906d-4d8b-9cc9-ae71a674e97a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:27.995661 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7091b-906d-4d8b-9cc9-ae71a674e97a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:27.996128 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7091b-906d-4d8b-9cc9-ae71a674e97a None admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:27.997458 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7091b-906d-4d8b-9cc9-ae71a674e97a None admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:27.999147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7091b-906d-4d8b-9cc9-ae71a674e97a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:28.001085 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 62/118] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:27 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:28.002461 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.002719 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.003147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.022860 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:28.024213 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:28.079233 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cd7a-da89-474b-9d1f-b9bac36b0ebd None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.103251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 63/119] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:28.104256 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.120656 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.121792 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.122230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.122667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.123591 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:28.125519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:28.167587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 57/120] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:30:27 2022] POST /identity/v3/projects => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:28.168665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.183043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:28.241616 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:28.262032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1823469-7602-4cae-80da-c3598160d6ca None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.301980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dea8f-af83-4fe5-a327-0019ba8db35d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.344837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.345850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.346294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.346626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.346895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.347441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.347823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.348219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.348722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:28.349246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:28.349704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:28.351306 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:28.351806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:28.355357 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:28.356993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.376331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:28.377197 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.460863 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:28.491575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90bd64-1290-431c-8b0c-137d70a62baa None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.516581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d66bb-47a3-46bf-b6af-fcd241021618 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.540327 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.541266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.541874 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.542163 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.554188 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.555050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.555395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.556008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/4896c73f97d94602afe7ed8c9d748471/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.556345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:28.558148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] RBAC: Authorizing `identity:create_grant(project_id=0a25fef9086f400895e3834cc2bc7398, user_id=4896c73f97d94602afe7ed8c9d748471, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:28.559682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:28.561476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:28.562967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:28.563745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.585138 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 65/124] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:28 2022] PUT /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/4896c73f97d94602afe7ed8c9d748471/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:28.586398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.603242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:28.715764 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752b91-a110-4e5e-bba2-fae8c764befc None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.724828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d822b-3109-484f-afb1-a8f47b0d230b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.767814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.768416 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.768760 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.769125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] PATH_INFO: `/v3/users/4b81ec2206814c889836f7e39b379897` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.773245 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:28.781236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50303634-6120-4180-968a-afd6504420c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.782381 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50303634-6120-4180-968a-afd6504420c2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.783139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50303634-6120-4180-968a-afd6504420c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.783841 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50303634-6120-4180-968a-afd6504420c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.789291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] RBAC: Authorizing `identity:get_user(user_id=4b81ec2206814c889836f7e39b379897)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:28.790801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:28.792525 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/users/4b81ec2206814c889836f7e39b379897 => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:28.793382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.800920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50303634-6120-4180-968a-afd6504420c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-50303634-6120-4180-968a-afd6504420c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:28.807317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:28.808668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:28.809475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:28.812894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:28.814291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50303634-6120-4180-968a-afd6504420c2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:28.906531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:28.926120 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2bce3-cc58-41b7-aa7f-e1d12eaabf88 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.940274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50303634-6120-4180-968a-afd6504420c2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:28.985779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.986415 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.987019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.987019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.987924 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:28.988827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:28.989315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:28.989785 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:28.990747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:28.991772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:28.993401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.014832 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 61/127] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.016183 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.062139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.068730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.137983 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:29.146750 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:29.172201 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 67/128] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:29.173390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.243593 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97a07-d632-4f3a-88ba-3182b9f92779 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.286828 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.287462 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.287744 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.288538 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.288823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd7a7-df2c-4429-8057-1ba766f257ab None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.289239 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:29.289541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.291024 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.303913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 62/129] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.303913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.339740 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.340735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.341255 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.341730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.343064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.344704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.346572 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 68/130] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.347546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.394491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:29.450057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737cbd-0773-4833-9173-f2dd6f4cdcd5 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.484764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.485781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.486260 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.486729 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.488068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.489735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.492058 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 69/131] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.493073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.512536 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b66def-1d64-4c01-822d-e7f1a25b62f4 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.542218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:29.580484 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.581240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.581529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.581810 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.585505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.586958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.588600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 63/132] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.590945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.595818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e291196-f1a6-495e-abe0-4d0a533d31ad None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.621160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:29.633390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.634713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.635208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.635665 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] PATH_INFO: `/v3/projects/3e5538d030614859b996b27ec15ee9e7` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.637114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] RBAC: Authorizing `identity:get_project(project_id=3e5538d030614859b996b27ec15ee9e7)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.638778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.641761 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 70/133] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/projects/3e5538d030614859b996b27ec15ee9e7 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.643235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.814502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d29e1-10f5-4005-a095-0861bc54a8a6 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.846862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c530b-858e-4b19-9a53-c3be0e4e2e1b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:29.891886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.892500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.892784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.893103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.893845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] RBAC: Adding query filter params (role.id=75c913ae91984e75a4755ca385ea7d80, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=4b81ec2206814c889836f7e39b379897) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:29.894157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.895627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.907554 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:29.908195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:29.908479 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:29.908756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:29.909969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:29.910744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 71/134] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/role_assignments?user.id=4b81ec2206814c889836f7e39b379897&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=75c913ae91984e75a4755ca385ea7d80 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.911424 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:29.911986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.913149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 64/135] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:29 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:29.920595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:29.990369 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:30.031011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:30.097190 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616f6fc-7dbb-44e4-88d2-53206536f24f None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:30.105304 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe0a6-fe76-4750-a981-4e61a5524118 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:30.146715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5994e-7cae-49c2-a5db-40dec77c80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:30.148440 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5994e-7cae-49c2-a5db-40dec77c80f4 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:30.148961 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5994e-7cae-49c2-a5db-40dec77c80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:30.149508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5994e-7cae-49c2-a5db-40dec77c80f4 None admin] PATH_INFO: `/v3/projects/3e5538d030614859b996b27ec15ee9e7/users/95ed238335d547508b979f5f80415d9b/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:30.152111 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5994e-7cae-49c2-a5db-40dec77c80f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e5538d030614859b996b27ec15ee9e7, user_id=95ed238335d547508b979f5f80415d9b, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:30.153960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5994e-7cae-49c2-a5db-40dec77c80f4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:30.167858 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e0f1-d9df-442b-b811-90ec7b61e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:30.168543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e0f1-d9df-442b-b811-90ec7b61e5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:30.168847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e0f1-d9df-442b-b811-90ec7b61e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:30.169127 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e0f1-d9df-442b-b811-90ec7b61e5f2 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/95ed238335d547508b979f5f80415d9b/roles/600c5bd8ce74469bb32ebbd74ce125cc` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:30.174030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 72/136] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:29 2022] PUT /identity/v3/projects/3e5538d030614859b996b27ec15ee9e7/users/95ed238335d547508b979f5f80415d9b/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:30.174706 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e0f1-d9df-442b-b811-90ec7b61e5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a25fef9086f400895e3834cc2bc7398, user_id=95ed238335d547508b979f5f80415d9b, role_id=600c5bd8ce74469bb32ebbd74ce125cc)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:30.176164 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e0f1-d9df-442b-b811-90ec7b61e5f2 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:30.192564 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 65/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:29 2022] PUT /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/95ed238335d547508b979f5f80415d9b/roles/600c5bd8ce74469bb32ebbd74ce125cc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 10 20:30:30.541145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772128-9397-4b50-9222-ed24bd49baf6 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:30.541638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772128-9397-4b50-9222-ed24bd49baf6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:30.542071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772128-9397-4b50-9222-ed24bd49baf6 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:30.543588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 73/138] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:30.550451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:30.550730 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:30.551005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:30.574361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:30.575596 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:30.654494 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 66/139] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:31.001019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772128-9397-4b50-9222-ed24bd49baf6 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:31.128027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:31.133412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772128-9397-4b50-9222-ed24bd49baf6 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:31.184408 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:31.185558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:31.186095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:31.186578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:31.202284 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:31.207693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:31.208548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:31.209330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:31.212486 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 74/140] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:31.217967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:31.273278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:31.359883 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910b484-3a12-4b9d-9cb0-f4ae116ac8f7 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:31.409673 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:31.410646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:31.411145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:31.411631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:31.412493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:31.413575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:31.415227 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:31.429741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 67/141] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:31.435849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:31.630796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c175d-065e-44a7-acd3-3d2a5898c34b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:31.754121 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207e9f-23d4-4880-8455-131ba3fe3624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:31.754773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207e9f-23d4-4880-8455-131ba3fe3624 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:31.755050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207e9f-23d4-4880-8455-131ba3fe3624 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:31.755324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207e9f-23d4-4880-8455-131ba3fe3624 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:31.761498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207e9f-23d4-4880-8455-131ba3fe3624 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:31.762962 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207e9f-23d4-4880-8455-131ba3fe3624 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:31.764944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 75/142] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:31 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:31.770755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:31.807478 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df624323-5f80-489b-91af-ebda8139e142 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:31.807817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df624323-5f80-489b-91af-ebda8139e142 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:31.808105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df624323-5f80-489b-91af-ebda8139e142 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:31.809884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 76/143] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:31.820389 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7aa07-01d0-4225-bcc2-9cf065e91041 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:31.820566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7aa07-01d0-4225-bcc2-9cf065e91041 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:31.820879 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7aa07-01d0-4225-bcc2-9cf065e91041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:31.878367 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-d1d7aa07-01d0-4225-bcc2-9cf065e91041 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:31.879918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-d1d7aa07-01d0-4225-bcc2-9cf065e91041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:31.935901 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:31.976471 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5fd55-207a-4b6d-a5ee-0cfcce0e6132 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:31.994067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:32.052375 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:32.060321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:32.060633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:32.060952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:32.094529 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 77/144] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:32.096866 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5cb0c-1063-48f7-82bf-3f6113e2ab8f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:32.097054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5cb0c-1063-48f7-82bf-3f6113e2ab8f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:32.099308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5cb0c-1063-48f7-82bf-3f6113e2ab8f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:32.099888 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 78/145] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:32.109576 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:32.109576 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:32.109576 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:32.178983 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:32.180206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:32.253034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:32.257102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:32.344677 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 79/146] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:32.470860 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 68/147] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:32.477139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:32.640644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:32.658516 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d2349-ca6f-44ac-a4b9-769d7505b7bc None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:32.710907 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:32.711530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:32.711806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:32.712071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:32.713212 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:32.714644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:32.716409 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 80/148] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:32 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:32.722360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:32.735473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:32.753538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:32.924335 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5449583-4a45-4d55-9f6f-09d5b5b08fb1 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:32.964433 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:32.965573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:32.966057 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:32.966539 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:32.967053 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bd6a-a06e-405c-9bfb-8fe58930eefe None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:32.967681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=95ed238335d547508b979f5f80415d9b) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:32.968186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:32.970011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:32.977897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 69/149] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:32 2022] GET /identity/v3/role_assignments?user.id=95ed238335d547508b979f5f80415d9b&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:32.978977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:33.077534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:33.078183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.078462 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.078735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.085931 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:33.087898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:33.093109 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 81/150] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:33.101807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:33.102739 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:33.162562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2319044-350c-41df-abd6-d468aae59a28 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:33.176899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:33.225167 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:33.226274 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.226751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.227229 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.247303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:33.259892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:33.261299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:33.262052 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:33.264526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 70/151] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:33.271668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:33.320833 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd5a23-5011-4191-9101-2674b65c8a64 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:33.372404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc986-0db1-426c-9594-a09191555028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:33.373077 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc986-0db1-426c-9594-a09191555028 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.373361 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc986-0db1-426c-9594-a09191555028 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.373637 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc986-0db1-426c-9594-a09191555028 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.374364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc986-0db1-426c-9594-a09191555028 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:33.375889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc986-0db1-426c-9594-a09191555028 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:33.414192 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 82/152] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:33 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:33.476328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007aa9-d3d6-4dba-ba84-cb76c1fd1f09 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:33.514630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:33.522787 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:33.523760 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.524293 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.524835 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.525693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:33.526212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:33.527787 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efe8a4-9e9c-494a-a990-163de6cf48e3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:33.538818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 71/153] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:33.544375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc986-0db1-426c-9594-a09191555028 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:33.638448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:33.661428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc986-0db1-426c-9594-a09191555028 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:33.693399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e55c19-df8f-4ed5-86ad-7f319887aaca None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.693720 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e55c19-df8f-4ed5-86ad-7f319887aaca None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.694467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e55c19-df8f-4ed5-86ad-7f319887aaca None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.696730 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 72/154] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:33.701332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:33.701970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.702323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.703751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c982684-6f2a-451f-9335-097ad5ceaeb7 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.704025 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c982684-6f2a-451f-9335-097ad5ceaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.704339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c982684-6f2a-451f-9335-097ad5ceaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.709922 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] PATH_INFO: `/v3/users/4896c73f97d94602afe7ed8c9d748471` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.717270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] RBAC: Authorizing `identity:get_user(user_id=4896c73f97d94602afe7ed8c9d748471)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:33.718795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:33.725145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 83/155] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:33 2022] GET /identity/v3/users/4896c73f97d94602afe7ed8c9d748471 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:33.731290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:33.741234 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-6c982684-6f2a-451f-9335-097ad5ceaeb7 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:33.742510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-6c982684-6f2a-451f-9335-097ad5ceaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:33.842642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 73/156] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:33.900106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160734-e745-4f46-a141-f1ad4f746e3c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:33.927025 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d00f1-5e27-47a0-b826-c70d89a62395 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.927307 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d00f1-5e27-47a0-b826-c70d89a62395 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.927601 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d00f1-5e27-47a0-b826-c70d89a62395 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.929649 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 74/157] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:33.934882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.935415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.935696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.945382 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917166d-7330-4ff6-ab33-f41667db3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:33.946246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917166d-7330-4ff6-ab33-f41667db3d44 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:33.946949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917166d-7330-4ff6-ab33-f41667db3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:33.947392 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917166d-7330-4ff6-ab33-f41667db3d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:33.960182 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:33.961751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:33.968245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:34.035124 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917166d-7330-4ff6-ab33-f41667db3d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:34.037119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917166d-7330-4ff6-ab33-f41667db3d44 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:34.052245 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 75/158] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:34.156717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 84/159] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:34.163533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.224651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e8b3-6746-4004-a2e6-251f2d87369f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.225358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e8b3-6746-4004-a2e6-251f2d87369f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.225822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e8b3-6746-4004-a2e6-251f2d87369f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.227352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 85/160] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:34.228344 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e8b3-6746-4004-a2e6-251f2d87369f None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.238440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:34.291565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab87ae-f327-4156-b965-9d3d19d2a195 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:34.309051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:34.335213 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd1a7b-0338-4d9a-b88f-4fa045010bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:34.336080 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1a7b-0338-4d9a-b88f-4fa045010bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.336572 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1a7b-0338-4d9a-b88f-4fa045010bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.337082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1a7b-0338-4d9a-b88f-4fa045010bf0 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.338363 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd1a7b-0338-4d9a-b88f-4fa045010bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:34.339952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd1a7b-0338-4d9a-b88f-4fa045010bf0 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:34.341807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 76/161] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:34.343297 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.343735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.344148 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.362374 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:34.363789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:34.374535 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e8b3-6746-4004-a2e6-251f2d87369f None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:34.429611 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:34.430410 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.430689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.430964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.447415 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:34.447613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 77/162] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:34.447613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:34.451686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:34.452541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:34.453442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 86/163] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:34.454068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.510300 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:34.578788 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc481-62cd-4587-894a-9baf1d0114d8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:34.579036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1697376-3875-4b56-8584-ab4c2e6226c3 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:34.592004 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:34.622545 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:34.624068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.624068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.624068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.624405 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=4896c73f97d94602afe7ed8c9d748471) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:34.624686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:34.626830 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:34.633848 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:34.635445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.635445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.635445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.637921 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 78/164] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/role_assignments?user.id=4896c73f97d94602afe7ed8c9d748471&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:34.638580 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.659142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:34.665716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:34.666685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:34.667470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:34.671242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 87/165] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:34.676749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.827756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eadc7-b6e0-4507-a57c-5b1f88e79e61 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:34.851448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb38541-68dc-4e3e-b520-043e691e9517 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:34.852056 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:34.888025 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:34.889064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.889539 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.890070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.891031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:34.894892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:34.899096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:34.918658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 79/166] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:34.921251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.927950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:34.929538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:34.930119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:34.930583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:34.931541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:34.932047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:34.933669 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:34.946687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 88/167] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:34.947852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:34.996759 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:35.080078 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336797-c6cb-42a5-9fea-bfbe17821524 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.119203 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.119799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.120080 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.120345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.137454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deef54d-357f-4217-8d43-b353296905a7 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.143556 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:35.153866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:35.154887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:35.155677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 80/168] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:35.156320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.208894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.209684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.209963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.210239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.212823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.216093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.221691 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 89/169] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:34 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:35.222611 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.239858 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:35.344161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4df79b-4fa7-4acf-a113-a0479424bd3c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.374788 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:35.382540 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677e5d0-e74d-434c-b093-e76ff4fd5c93 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.385033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.386413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.386413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.386413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] PATH_INFO: `/v3/users/4b81ec2206814c889836f7e39b379897` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.387520 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] RBAC: Authorizing `identity:get_user(user_id=4b81ec2206814c889836f7e39b379897)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.389004 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.391147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 81/170] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/users/4b81ec2206814c889836f7e39b379897 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:35.391811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.423558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.424533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.425088 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.425589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.426513 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:35.427010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.429135 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.438266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 90/171] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:35.439341 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.507408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab336598-84f0-434e-a5cb-65fb3f268dfd None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.510685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:35.558433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d27eff-3411-4a65-a54e-abdd9f3602b0 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.574314 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.575286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.575396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.575614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.597042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.598057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.598558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.599050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.600698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.603859 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.606249 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 91/172] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:35.607260 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.644001 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:35.718455 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71231b12-a8ad-4c3d-b5e5-6b5e1205faf0 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.733869 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.735357 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.755602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.757129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.757631 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.758193 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] PATH_INFO: `/v3/users/95ed238335d547508b979f5f80415d9b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.759552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] RBAC: Authorizing `identity:get_user(user_id=95ed238335d547508b979f5f80415d9b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.761291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.763178 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 92/173] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/users/95ed238335d547508b979f5f80415d9b => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:35.764162 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.873411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:35.878194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028366c5-25af-4671-80f4-7bebefe90a75 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:35.914672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:35.915649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:35.916148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:35.916623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/4b81ec2206814c889836f7e39b379897/roles/75c913ae91984e75a4755ca385ea7d80` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:35.918860 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a25fef9086f400895e3834cc2bc7398, user_id=4b81ec2206814c889836f7e39b379897, role_id=75c913ae91984e75a4755ca385ea7d80)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:35.920631 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:35.936844 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 93/174] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:35 2022] PUT /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398/users/4b81ec2206814c889836f7e39b379897/roles/75c913ae91984e75a4755ca385ea7d80 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:35.938384 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.944364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 82/175] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:35.953736 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:35.963074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:36.092892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ef520-6b2b-4198-992b-0caafcfd33f1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:36.130721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:36.132887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:36.133419 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:36.134098 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:36.169273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:36.211851 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:36.214399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:36.259001 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904431f-6ce2-494e-b8aa-87ef2dae902a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:36.329442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 94/176] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:36.337193 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:36.354883 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:36.355533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:36.355786 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:36.356060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:36.357822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:36.359276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:36.361267 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 83/177] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:35 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:36.367670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:36.448901 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:36.529637 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50245d44-ea5a-485e-b35c-3f87a31b6d30 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:36.531833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:36.578136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8e0df-fdcf-4adc-a07e-960d2ee84655 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:36.626079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:36.626719 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:36.626997 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:36.627265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] PATH_INFO: `/v3/projects/3e5538d030614859b996b27ec15ee9e7` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:36.628397 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] RBAC: Authorizing `identity:get_project(project_id=3e5538d030614859b996b27ec15ee9e7)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:36.629881 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:36.632377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 95/178] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:36 2022] GET /identity/v3/projects/3e5538d030614859b996b27ec15ee9e7 => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:36.636029 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:36.636960 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:36.637441 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:36.637927 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:36.638029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:36.639056 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] RBAC: Adding query filter params (role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=95ed238335d547508b979f5f80415d9b) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:36.639581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:36.641254 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd12992-3a95-433a-9792-4aa4f6e38579 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:36.654674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 84/179] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:36 2022] GET /identity/v3/role_assignments?user.id=95ed238335d547508b979f5f80415d9b&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:36.826554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fa339-4ba0-42ac-9cce-089cb4b737ec None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:36.864327 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:36.879729 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:36.880664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:36.881186 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:36.882208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:36.883594 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=3e5538d030614859b996b27ec15ee9e7, user.id=95ed238335d547508b979f5f80415d9b) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:36.883932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:36.885449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b274a-f064-4bf9-9d3b-ffe4d166bf49 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:36.898619 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 96/180] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:36 2022] GET /identity/v3/role_assignments?user.id=95ed238335d547508b979f5f80415d9b&scope.project.id=3e5538d030614859b996b27ec15ee9e7&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:37.559466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8969c-cc1c-4d1f-871a-42ca26a38aeb None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:37.559466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8969c-cc1c-4d1f-871a-42ca26a38aeb None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:37.559466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8969c-cc1c-4d1f-871a-42ca26a38aeb None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:37.559466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 85/181] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:37.567990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb5779-85b0-4fea-ad4e-2dce6360e6d7 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:37.568443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb5779-85b0-4fea-ad4e-2dce6360e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:37.568520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb5779-85b0-4fea-ad4e-2dce6360e6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:37.595364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-eebb5779-85b0-4fea-ad4e-2dce6360e6d7 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:37.596564 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-eebb5779-85b0-4fea-ad4e-2dce6360e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:37.701507 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c932a-843a-4125-b706-991e70a2b957 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:37.701854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c932a-843a-4125-b706-991e70a2b957 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:37.702060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c932a-843a-4125-b706-991e70a2b957 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:37.707924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 97/182] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:37.712865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 86/183] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:37.725930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb185-45af-4189-85e3-298707f6c05d None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:37.726530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb185-45af-4189-85e3-298707f6c05d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:37.727021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb185-45af-4189-85e3-298707f6c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:37.747129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-0b4eb185-45af-4189-85e3-298707f6c05d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:37.748655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-0b4eb185-45af-4189-85e3-298707f6c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:37.828904 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 98/184] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:37.998464 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13565fc8-61cc-41e1-971c-edd00491ed96 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:37.998733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13565fc8-61cc-41e1-971c-edd00491ed96 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:37.999028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13565fc8-61cc-41e1-971c-edd00491ed96 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.000677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 87/185] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:38.006429 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.006716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.006985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.025234 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:38.026392 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:38.070596 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:38.111982 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13565fc8-61cc-41e1-971c-edd00491ed96 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.126986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 99/186] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:38.173991 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.320818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13565fc8-61cc-41e1-971c-edd00491ed96 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.360757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cbd32-7ade-41da-8274-2c8d6683c9c4 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.384982 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.385303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.386580 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.386580 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.390848 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:38.407508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:38.416322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:38.417396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:38.418171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:38.423664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 88/187] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:30:38.425106 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.431245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.431245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.431245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.431245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.444674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:38.451899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:38.452783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:38.453597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 100/188] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:38.463353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.510651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:38.547836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eeb41-80fd-479d-9877-93316c544ad9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.578282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dc160-63f3-423d-b4fa-742db1b1f88e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.583035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.583635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.583913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.584183 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.585712 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:38.586245 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:38.588757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:38.604019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 89/189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:38.604019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.619509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.620112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.620391 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.620663 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.621349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:38.621647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:38.623013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:38.631143 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 101/190] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:38.631968 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.680226 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:38.726517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ae89-4d74-41c0-b8aa-d8c6919b3302 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.756117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:38.760355 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b221580-5599-4f02-b8f1-7ee075a2a859 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.768322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.768985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.769266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.769541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.770647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:38.772137 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:38.773892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 90/191] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:38.778911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.798808 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.799447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.799726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.799997 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] PATH_INFO: `/v3/users/67b5e6dbdc87496b973923fc4eda5e01` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.815141 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=67b5e6dbdc87496b973923fc4eda5e01)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:38.816606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:38.823243 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 102/192] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/users/67b5e6dbdc87496b973923fc4eda5e01 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:38.823243 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.892554 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61cc5-2328-43cb-ae27-297f4a5a8580 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.919679 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:38.929731 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.930409 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.930645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.930907 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] PATH_INFO: `/v3/users/67b5e6dbdc87496b973923fc4eda5e01` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.932172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] RBAC: Authorizing `identity:get_user(user_id=67b5e6dbdc87496b973923fc4eda5e01)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:38.933788 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:38.940020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 91/193] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/users/67b5e6dbdc87496b973923fc4eda5e01 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:38.940145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e639d-2e39-47df-bd3d-d7e18c5ad1c2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:38.940252 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:38.991721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:38.992337 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:38.992616 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:38.992945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:38.993604 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:38.995795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:39.018564 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 103/194] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:38 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:39.019229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:39.046803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:39.078696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e0c4d-8d66-4d4b-8d82-c8b87753a77d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:39.138975 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ba7d4-ae0d-4e15-98e6-a7e97aa5ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:39.139635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba7d4-ae0d-4e15-98e6-a7e97aa5ec44 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.139913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba7d4-ae0d-4e15-98e6-a7e97aa5ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.140310 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba7d4-ae0d-4e15-98e6-a7e97aa5ec44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.175427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4a70-ba6f-4531-ae03-5fd91b8fa1b0 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:39.215978 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:39.217497 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:39.217911 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.218307 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.218778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.224636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ba7d4-ae0d-4e15-98e6-a7e97aa5ec44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:39.226713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ba7d4-ae0d-4e15-98e6-a7e97aa5ec44 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:39.307139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:39.308627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:39.326004 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:39.357101 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 92/195] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:39.361916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688f0e8-db39-4dbb-a1d2-0cb0ab8571ce None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.361916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688f0e8-db39-4dbb-a1d2-0cb0ab8571ce None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.361916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688f0e8-db39-4dbb-a1d2-0cb0ab8571ce None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.361916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 93/196] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:39.367132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.367807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.368091 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.394950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:39.396188 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:39.465590 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 104/197] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:39.470328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:39.478064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 94/198] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:39.479344 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:39.508587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:39.585350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b556-f683-4603-8b50-e1ae1bd4bb94 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:39.600568 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:39.624269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:39.625265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.625690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.626106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.627387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:39.629028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:39.630831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 105/199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:39 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:39.637418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:39.746854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04729152-d8d4-41fa-a920-1195ad29e003 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:39.750652 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97a78c-2a99-4ef7-98ab-376b26bdfa80 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:39.789354 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:39.790400 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.790828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.791245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.792114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=67b5e6dbdc87496b973923fc4eda5e01) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:39.792565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:39.794529 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:39.800870 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 106/200] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:39 2022] GET /identity/v3/role_assignments?user.id=67b5e6dbdc87496b973923fc4eda5e01&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:39.851115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:39.860814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:39.861480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:39.861755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:39.862024 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:39.866475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:39.867766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:39.869763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 95/201] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:39 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:39.875582 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:39.916342 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:39.983065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec40cbe-e307-48ae-9885-a93ef8ae652c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:40.064399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:40.064399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:40.064399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:40.064399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:40.079136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:40.080568 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:40.087942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:40.088927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:40.090760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:40.095786 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 107/202] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:40.097959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:40.100840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189e02-fd77-4a1e-9142-5d263be63443 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:40.167570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:40.168819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:40.168819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:40.168819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:40.170379 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] RBAC: Adding query filter params (role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=67b5e6dbdc87496b973923fc4eda5e01) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:40.170379 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:40.175486 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:40.204967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 96/203] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:39 2022] GET /identity/v3/role_assignments?user.id=67b5e6dbdc87496b973923fc4eda5e01&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:40.292823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdf1e8-d3bb-4e8e-9d4f-48c62ad28a09 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:40.305685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:40.376606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:40.377250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:40.377532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:40.377804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:40.378521 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:40.378830 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:40.380308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:40.397746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 108/204] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:40.403646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:40.567175 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bb489-c0b7-4d49-b76c-9101fa539222 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:40.612364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:40.613114 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:40.613399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:40.613918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] PATH_INFO: `/v3/users/4b81ec2206814c889836f7e39b379897` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:40.614805 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] RBAC: Authorizing `identity:get_user(user_id=4b81ec2206814c889836f7e39b379897)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:40.616853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:40.623266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 97/205] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:40 2022] GET /identity/v3/users/4b81ec2206814c889836f7e39b379897 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:40.625173 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:40.810584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6e325-c0be-48ae-beaa-62eb6bd3fbdf None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:40.894511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:40.895558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:40.896062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:40.896532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:40.957831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:41.036276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:41.038312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:41.167135 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 109/206] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:41.175903 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:41.221493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:41.385171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b4db-a268-4335-ba91-4e4b50c7be1e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:41.437795 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659740d-153c-427f-8061-468191f42d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:41.438345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659740d-153c-427f-8061-468191f42d4b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:41.438625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659740d-153c-427f-8061-468191f42d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:41.438897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659740d-153c-427f-8061-468191f42d4b None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:41.441526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659740d-153c-427f-8061-468191f42d4b None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:41.443015 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659740d-153c-427f-8061-468191f42d4b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:41.444752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 98/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:41 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:41.453210 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:41.601179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:41.650420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d3acb-93c9-4bee-be24-2b93cecb5b75 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:41.706570 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:41.707522 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:41.708020 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:41.708487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:41.709466 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] RBAC: Adding query filter params (role.id=75c913ae91984e75a4755ca385ea7d80, scope.project.id=0a25fef9086f400895e3834cc2bc7398, user.id=4b81ec2206814c889836f7e39b379897) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:41.709976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:41.711642 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae2ad-a478-4056-bcf0-961c0db43b59 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:41.721301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 110/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:41 2022] GET /identity/v3/role_assignments?user.id=4b81ec2206814c889836f7e39b379897&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=75c913ae91984e75a4755ca385ea7d80 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:42.116491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441860-95b5-4a8b-bdb9-729881653f61 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.116871 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441860-95b5-4a8b-bdb9-729881653f61 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.117077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441860-95b5-4a8b-bdb9-729881653f61 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.118670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 99/209] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:42.124265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c7b6-34d7-4be2-a8c8-561fe9aac20e None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.124562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c7b6-34d7-4be2-a8c8-561fe9aac20e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.124871 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c7b6-34d7-4be2-a8c8-561fe9aac20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.151882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2502c7b6-34d7-4be2-a8c8-561fe9aac20e None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:42.153260 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2502c7b6-34d7-4be2-a8c8-561fe9aac20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:42.167005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbce52-c61d-4751-a9b0-83c11e48c9a8 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.167293 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbce52-c61d-4751-a9b0-83c11e48c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.167727 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbce52-c61d-4751-a9b0-83c11e48c9a8 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.169802 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 100/210] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:42.176423 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174345-8751-4738-a560-52682e65357f None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.177010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174345-8751-4738-a560-52682e65357f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.177010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174345-8751-4738-a560-52682e65357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.202977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-8b174345-8751-4738-a560-52682e65357f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:42.204648 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-8b174345-8751-4738-a560-52682e65357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:42.244357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 111/211] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:42.299934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 101/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:42.526150 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55c56-4a4e-4835-b68a-ac1a22786778 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.526491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55c56-4a4e-4835-b68a-ac1a22786778 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.526670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55c56-4a4e-4835-b68a-ac1a22786778 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.528237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 112/213] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:42.533457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.533745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.534018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.552668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:42.554463 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:42.578013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:42.601347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55c56-4a4e-4835-b68a-ac1a22786778 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:42.629762 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 102/214] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:42.630995 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:42.693606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:42.763460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55c56-4a4e-4835-b68a-ac1a22786778 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:42.781020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c95a4-c0a4-481f-9e56-28fcb305a334 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:42.818266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:42.823672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.824264 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.824750 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.827484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:42.830361 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:42.831789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:42.832488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:42.832774 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:42.833073 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:42.837623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 113/215] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:42.841160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:42.848834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:42.855089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:42.856010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:42.856783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 103/216] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:42.866995 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:42.891125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:43.013018 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8b01e-168a-4e20-8c8e-97d3c9b4e405 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:43.043061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603745ee-d7d0-44d9-bea8-8838769887e5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:43.048993 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:43.057395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:43.058009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.058549 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.058959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.060221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:43.062382 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:43.091895 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 114/217] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:42 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:43.092733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:43.093698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:43.095073 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.095572 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.096059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.097353 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:43.098014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:43.101048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:43.120354 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 104/218] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:43.121672 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:43.235787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749942b8-05fc-420d-af86-d1cf9eaff058 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:43.290155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c363810-a57f-498e-863a-ab8c5896ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:43.290782 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c363810-a57f-498e-863a-ab8c5896ab7a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.291067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c363810-a57f-498e-863a-ab8c5896ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.291342 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c363810-a57f-498e-863a-ab8c5896ab7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.302806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c363810-a57f-498e-863a-ab8c5896ab7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-2c363810-a57f-498e-863a-ab8c5896ab7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:43.308235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:43.309206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:43.310073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:43.310671 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:43.311076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 115/219] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:43.311076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b275c-0875-407e-8d5c-8475d37280c1 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.311076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b275c-0875-407e-8d5c-8475d37280c1 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.311260 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b275c-0875-407e-8d5c-8475d37280c1 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.312502 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 116/220] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:43.317965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b275c-0875-407e-8d5c-8475d37280c1 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:43.341567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec87c-c676-4086-8133-5adfc8c9c2ec None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:43.379217 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:43.410660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952f05-ba33-4c6e-a9f8-119bfa5842f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:43.411552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952f05-ba33-4c6e-a9f8-119bfa5842f3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.411970 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952f05-ba33-4c6e-a9f8-119bfa5842f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.413031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952f05-ba33-4c6e-a9f8-119bfa5842f3 None admin] PATH_INFO: `/v3/users/4cca6860b31145abb6b848e1334fcd87` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.438214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952f05-ba33-4c6e-a9f8-119bfa5842f3 None admin] RBAC: Authorizing `identity:get_user(user_id=4cca6860b31145abb6b848e1334fcd87)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:43.439827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952f05-ba33-4c6e-a9f8-119bfa5842f3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:43.442965 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 105/221] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:43 2022] GET /identity/v3/users/4cca6860b31145abb6b848e1334fcd87 => generated 297 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:43.451658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05758-c380-416c-ab73-869b05528678 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.454303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05758-c380-416c-ab73-869b05528678 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.454875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05758-c380-416c-ab73-869b05528678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.485838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b275c-0875-407e-8d5c-8475d37280c1 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:43.491035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-87c05758-c380-416c-ab73-869b05528678 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:43.492256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-87c05758-c380-416c-ab73-869b05528678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:43.564609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:43.566151 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.567361 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.570163 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.572043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:43.573323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:43.575716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:43.589751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 106/222] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:43.589751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05758-c380-416c-ab73-869b05528678 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:43.599384 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 117/223] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:43.607174 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:43.656009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:43.735132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05758-c380-416c-ab73-869b05528678 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:43.866559 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:43.867164 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:43.867439 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:43.869719 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:43.990175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157ed70-ab9d-4dfa-94f3-4cb1b6156059 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:44.026744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:44.125086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:44.125839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:44.126273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:44.126545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] PATH_INFO: `/v3/users/67b5e6dbdc87496b973923fc4eda5e01` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:44.129483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] RBAC: Authorizing `identity:get_user(user_id=67b5e6dbdc87496b973923fc4eda5e01)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:44.132575 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:44.139772 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 118/224] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:43 2022] GET /identity/v3/users/67b5e6dbdc87496b973923fc4eda5e01 => generated 283 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:44.139772 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:44.148451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:44.152721 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:44.312535 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f70a8-fee2-4ad6-8bbe-25ad86920b67 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:44.371047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:44.371047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:44.371047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:44.371047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:44.390135 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:44.397787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:44.398655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:44.399432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 119/225] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:30:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:44.400076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:44.431264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:44.576529 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:44.581918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 107/226] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 992 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:44.583663 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:44.798269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8f81-86f8-4c1f-ad77-24f2f6b25456 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:44.842710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:44.842986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97048-0dcb-4ce2-b221-d96b12eb4c17 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:44.843614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:44.843996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:44.844368 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:44.845649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:44.848248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:44.855732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 120/227] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:44 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:44.856365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:44.889559 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:44.890370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:44.890786 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:44.891192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:44.892303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:44.893195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:44.894573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:44.911476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 108/228] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:30:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:44.911476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:44.955794 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:44.990894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae51cd-b719-4bcd-bce5-2fdd7c47b248 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:44.994162 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:45.030850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:45.032166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.032613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.033510 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.035371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:45.038022 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:45.040244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 121/229] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:44 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:45.041362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:45.069809 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946cbe-98fc-4d9d-9023-6efe1a0489d3 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:45.110781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:45.111451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.111736 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.112049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/67b5e6dbdc87496b973923fc4eda5e01/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.114099 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8adffa42de46efb50aab220c9dfd70, user_id=67b5e6dbdc87496b973923fc4eda5e01, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:45.115689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:45.141072 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 109/230] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:44 2022] PUT /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/67b5e6dbdc87496b973923fc4eda5e01/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:45.142466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:45.236513 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d438-1d31-4d77-b62c-f4cd95430fdb None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:45.306931 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:45.307574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.307852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.308124 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] PATH_INFO: `/v3/users/67b5e6dbdc87496b973923fc4eda5e01` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.309469 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] RBAC: Authorizing `identity:get_user(user_id=67b5e6dbdc87496b973923fc4eda5e01)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:45.315845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:45.317882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:45.324122 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 122/231] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:45 2022] GET /identity/v3/users/67b5e6dbdc87496b973923fc4eda5e01 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:45.327256 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:45.354706 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6b476-2d35-404e-aeee-bfd3632d7ad6 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:45.415515 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:45.424096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:45.425043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.425502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.425959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.426909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=4cca6860b31145abb6b848e1334fcd87) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:45.427402 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:45.429617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:45.444595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 110/232] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:45 2022] GET /identity/v3/role_assignments?user.id=4cca6860b31145abb6b848e1334fcd87&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:45.496845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619a4d-8bd6-409c-aff5-ec5e5973d0df None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:45.542963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12e8ff-7d1a-4aaa-9037-74ff08920923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:45.543963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12e8ff-7d1a-4aaa-9037-74ff08920923 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.544413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12e8ff-7d1a-4aaa-9037-74ff08920923 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.544917 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12e8ff-7d1a-4aaa-9037-74ff08920923 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.546380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12e8ff-7d1a-4aaa-9037-74ff08920923 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:45.548040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12e8ff-7d1a-4aaa-9037-74ff08920923 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:45.549953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 123/233] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:45 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:45.556656 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:45.728991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54dc33-0bcb-4301-9024-4ebe7d00672d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:45.770451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77aeed-ed5b-4d84-97ea-eac950708d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:45.771968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77aeed-ed5b-4d84-97ea-eac950708d19 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.772416 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77aeed-ed5b-4d84-97ea-eac950708d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.772920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77aeed-ed5b-4d84-97ea-eac950708d19 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/67b5e6dbdc87496b973923fc4eda5e01/roles/600c5bd8ce74469bb32ebbd74ce125cc` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.775282 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77aeed-ed5b-4d84-97ea-eac950708d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8adffa42de46efb50aab220c9dfd70, user_id=67b5e6dbdc87496b973923fc4eda5e01, role_id=600c5bd8ce74469bb32ebbd74ce125cc)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:45.776932 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77aeed-ed5b-4d84-97ea-eac950708d19 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:45.792380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 111/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:45 2022] PUT /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/67b5e6dbdc87496b973923fc4eda5e01/roles/600c5bd8ce74469bb32ebbd74ce125cc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:45.967669 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac301a1d-adee-42df-bd2a-7da653c1e47d None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.968351 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac301a1d-adee-42df-bd2a-7da653c1e47d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.968884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac301a1d-adee-42df-bd2a-7da653c1e47d None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.970439 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 124/235] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:45.976743 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aff389-e288-4432-bce2-e21b5784fc92 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.977060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aff389-e288-4432-bce2-e21b5784fc92 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.977278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.977401 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aff389-e288-4432-bce2-e21b5784fc92 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.977863 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.978320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:45.978653 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 125/236] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:45.987359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:45.987891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:45.988373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:46.022927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:46.024644 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:46.026166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:46.027729 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:46.033529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:46.140145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 126/237] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:46.146524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 112/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:46.470140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:46.511824 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:46.574357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716919a0-e9c5-4d33-8828-50d90ec4e38c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:46.618850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:46.619573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:46.619849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:46.620170 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:46.625511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:46.626961 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:46.628887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 127/239] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:46.635499 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:46.697721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:46.864158 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5865f0-9e18-4ed1-b65f-a54de61ae04d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:46.877141 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:46.879442 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53e93-f061-43c5-8356-6a846a94b629 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:46.928206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:46.929459 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:46.929769 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:46.931230 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:46.944569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:46.951148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:46.952006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:46.952781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 128/240] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:30:46.958173 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:46.963914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:46.964528 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:46.964823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:46.965110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:46.965757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:46.967201 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:46.997771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:47.024077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 113/241] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:46 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:30:47.165838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098b93f-55f0-40c9-b00d-2b3ffe668fb9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:47.218791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:47.219662 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:47.220085 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:47.220523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:47.221381 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:47.221823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:47.223393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:47.236946 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 129/242] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:47.239690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:47.426111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9864ace-6f8f-42db-9135-6fb19435e334 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:47.463201 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:47.463838 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:47.464113 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:47.464387 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] PATH_INFO: `/v3/users/92d31e591e3c47ca8cac0865c0a3783a` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:47.488287 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] RBAC: Authorizing `identity:get_user(user_id=92d31e591e3c47ca8cac0865c0a3783a)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:47.490830 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:47.492928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 114/243] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:47 2022] GET /identity/v3/users/92d31e591e3c47ca8cac0865c0a3783a => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:47.498488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:47.538292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:47.632708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803c928-1bf3-4b14-a63a-d8723f7a4b2b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:47.686529 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:47.687070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:47.687352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:47.687628 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:47.762654 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:47.764660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:47.799644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:47.883103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 130/244] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:47.888632 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:47.974000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:48.040563 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed4d9-22e9-4921-bc41-00ac91a11019 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:48.081420 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4392ccf-e16b-4cac-b401-f0f804c1744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:48.082101 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392ccf-e16b-4cac-b401-f0f804c1744f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:48.082380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392ccf-e16b-4cac-b401-f0f804c1744f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:48.082654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4392ccf-e16b-4cac-b401-f0f804c1744f None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:48.083980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4392ccf-e16b-4cac-b401-f0f804c1744f None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:48.085562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4392ccf-e16b-4cac-b401-f0f804c1744f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:48.087774 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 115/245] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:47 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:48.093993 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:48.202087 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30643-7256-4186-9a91-ec545de35b13 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:48.202366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30643-7256-4186-9a91-ec545de35b13 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:48.202878 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30643-7256-4186-9a91-ec545de35b13 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:48.204589 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 116/246] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:48.210555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b273-52b1-45e1-840f-a634e2212f98 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:48.211293 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b273-52b1-45e1-840f-a634e2212f98 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:48.211766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b273-52b1-45e1-840f-a634e2212f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:48.252700 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-dea0b273-52b1-45e1-840f-a634e2212f98 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:48.256098 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866dba7-a4f2-4a8d-adf7-ed186a3a8885 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:48.259047 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-dea0b273-52b1-45e1-840f-a634e2212f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:48.288643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:48.306831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:48.307454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:48.307713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:48.307983 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:48.308705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] RBAC: Adding query filter params (role.id=75c913ae91984e75a4755ca385ea7d80, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=92d31e591e3c47ca8cac0865c0a3783a) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:48.309030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:48.310478 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:48.316467 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 131/247] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:48 2022] GET /identity/v3/role_assignments?user.id=92d31e591e3c47ca8cac0865c0a3783a&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=75c913ae91984e75a4755ca385ea7d80 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:48.411342 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 117/248] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:48.838867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:48.842575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9013d-c80c-40db-a8fc-5ed142a87280 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:48.842851 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9013d-c80c-40db-a8fc-5ed142a87280 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:48.843119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9013d-c80c-40db-a8fc-5ed142a87280 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:48.844567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 118/249] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:30:48.856640 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98be80-e26d-479f-bc14-8cf37ade5eac None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:48.856961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98be80-e26d-479f-bc14-8cf37ade5eac None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:48.857221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98be80-e26d-479f-bc14-8cf37ade5eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:48.887110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-4b98be80-e26d-479f-bc14-8cf37ade5eac None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:48.888440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-4b98be80-e26d-479f-bc14-8cf37ade5eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:49.003578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02feb2f-3dd9-4e95-96d0-8caea4136fa5 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:49.029155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:49.042254 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3fd56-34d3-488e-b285-58a254ddf09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:49.042254 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3fd56-34d3-488e-b285-58a254ddf09c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.042531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3fd56-34d3-488e-b285-58a254ddf09c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.042605 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3fd56-34d3-488e-b285-58a254ddf09c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.054287 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3fd56-34d3-488e-b285-58a254ddf09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b7f3fd56-34d3-488e-b285-58a254ddf09c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:49.059804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:49.060696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:49.061501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 132/250] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:49.062882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d5639-9104-45d0-b51f-876895358a2f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.062882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d5639-9104-45d0-b51f-876895358a2f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.062882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d5639-9104-45d0-b51f-876895358a2f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.064586 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 133/251] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:49.069728 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d5639-9104-45d0-b51f-876895358a2f None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:49.114502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 119/252] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:49.116298 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.116586 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.116876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.128580 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:49.165874 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:49.167100 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:49.191115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d5639-9104-45d0-b51f-876895358a2f None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:49.239301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:49.240433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.241186 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.241571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.242328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:49.242730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:49.244272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:49.260086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 134/253] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:49.267636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:49.426443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323a31-e593-416e-a3de-f7f7f75f6550 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:49.447950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 120/254] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:49.469157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:49.482544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:49.483339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.483627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.483906 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] PATH_INFO: `/v3/users/67b5e6dbdc87496b973923fc4eda5e01` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.485093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] RBAC: Authorizing `identity:get_user(user_id=67b5e6dbdc87496b973923fc4eda5e01)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:49.486556 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:49.488417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 135/255] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:49 2022] GET /identity/v3/users/67b5e6dbdc87496b973923fc4eda5e01 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:49.493969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:49.506514 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:49.682591 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2153-b6a1-4f05-bd3e-9363b81fabd2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:49.719404 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4565-cfe0-4b7a-95f1-450e69d3fe0e None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:49.753161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:49.754767 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:49.755620 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.756011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.756348 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.774417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:49.787710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:49.788588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:49.789420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 136/256] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:49.798679 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:49.799292 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:49.799572 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:49.799845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:49.799944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:49.887493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:49.943277 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:49.948268 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:50.052410 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938deb9d-6144-486e-b8a0-d1636a0860de None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:50.102324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 121/257] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:50.103198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:50.121302 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:50.135130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:50.136177 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:50.137563 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:50.138202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:50.140223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:50.140824 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:50.142632 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:50.164126 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 137/258] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:50.171788 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:50.296753 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d08842-9b7d-45ef-ab71-504227db9695 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:50.300582 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:50.334559 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:50.335380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:50.335782 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:50.336169 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:50.337522 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:50.339259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:50.341185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 138/259] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:50.342113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:50.408850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa5c6b-fc4f-47fc-ab7b-7f49c475cf2a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:50.461616 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7db54-bf58-41e5-b865-53144ca3a483 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:50.489696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:50.491270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:50.491709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:50.492007 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:50.528822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:50.537019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:50.537980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:50.538756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 122/260] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:50.539397 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:50.557813 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:50.558378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:50.558660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:50.559221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] PATH_INFO: `/v3/users/4cca6860b31145abb6b848e1334fcd87` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:50.560370 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] RBAC: Authorizing `identity:get_user(user_id=4cca6860b31145abb6b848e1334fcd87)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:50.561953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:50.563541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 139/261] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/users/4cca6860b31145abb6b848e1334fcd87 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:50.564307 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:50.655831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:50.718559 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:50.779751 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea54ae4-60dd-4491-b5ae-ab1baa063933 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:50.796628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152980a-61cf-40c9-bce6-e69a4e18fdb2 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:50.850277 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:50.850879 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:50.851677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:50.852290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:50.852544 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:50.852825 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:50.856824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=67b5e6dbdc87496b973923fc4eda5e01) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:50.856824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:50.856824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:50.857073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:50.857339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:50.858924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:50.858924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:50.860821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:50.873672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 140/262] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:50.873985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:50.883598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 123/263] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/role_assignments?user.id=67b5e6dbdc87496b973923fc4eda5e01&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:50.884820 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:51.053599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711cf0-ad08-48ab-9b18-6405f59eaa9c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:51.056767 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:51.139473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6157c1-1bf2-4d99-8110-23ba396aac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:51.139803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6157c1-1bf2-4d99-8110-23ba396aac55 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.140005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6157c1-1bf2-4d99-8110-23ba396aac55 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.140584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6157c1-1bf2-4d99-8110-23ba396aac55 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.143171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6157c1-1bf2-4d99-8110-23ba396aac55 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:51.143703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6157c1-1bf2-4d99-8110-23ba396aac55 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:51.147092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 141/264] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:51.148681 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c921-d2a0-48ec-adfe-21c6800d2e03 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.150185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c921-d2a0-48ec-adfe-21c6800d2e03 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.150185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c921-d2a0-48ec-adfe-21c6800d2e03 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.150503 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 142/265] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:51.151501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c0e87-17b3-4067-8c34-51bd4097fe43 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:51.153673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320f97-1b2d-4186-826d-df5be7a6d1d4 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.153965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320f97-1b2d-4186-826d-df5be7a6d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.154373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320f97-1b2d-4186-826d-df5be7a6d1d4 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.159898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 143/266] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:51.159898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4175f7b-68b3-458b-9616-b382554a2866 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.159898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4175f7b-68b3-458b-9616-b382554a2866 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.160173 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4175f7b-68b3-458b-9616-b382554a2866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.188515 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f4175f7b-68b3-458b-9616-b382554a2866 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:51.190371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f4175f7b-68b3-458b-9616-b382554a2866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:51.223600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:51.225755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.226047 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.226353 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] PATH_INFO: `/v3/users/67b5e6dbdc87496b973923fc4eda5e01` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.228877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] RBAC: Authorizing `identity:get_user(user_id=67b5e6dbdc87496b973923fc4eda5e01)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:51.233016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:51.233016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 124/267] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:50 2022] GET /identity/v3/users/67b5e6dbdc87496b973923fc4eda5e01 => generated 283 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:51.238530 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:51.242443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:51.286064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 144/268] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:51.287996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.288495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.288598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.317449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:51.317449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:51.452724 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fc20a-57f4-4cb6-980d-d7ce5e8661f8 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:51.456326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 145/269] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:51.457370 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:51.516855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:51.520448 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dfdee-fe80-44ea-94f0-61eae0dd7584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:51.523722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfdee-fe80-44ea-94f0-61eae0dd7584 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.524171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfdee-fe80-44ea-94f0-61eae0dd7584 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.524608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfdee-fe80-44ea-94f0-61eae0dd7584 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/4cca6860b31145abb6b848e1334fcd87/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.531358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dfdee-fe80-44ea-94f0-61eae0dd7584 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8adffa42de46efb50aab220c9dfd70, user_id=4cca6860b31145abb6b848e1334fcd87, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:51.533006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dfdee-fe80-44ea-94f0-61eae0dd7584 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:51.559072 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 125/270] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:51 2022] PUT /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/4cca6860b31145abb6b848e1334fcd87/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:51.638538 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41e20-8880-446e-a870-463761af66c1 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.638855 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41e20-8880-446e-a870-463761af66c1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.639079 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41e20-8880-446e-a870-463761af66c1 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.640592 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 126/271] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:51.642685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1862a-177f-4fd9-83db-3dd1c77e4264 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:51.651849 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.652125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.652398 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.696383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:51.697811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:51.698728 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:51.699472 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.699863 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.700228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:51.782781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:51.791977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:51.795266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:51.802264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 127/272] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:51.802264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:51.838207 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:51.929432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 146/273] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:51.930468 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:51.946845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988813a-b912-4ce7-8c57-6ac8147a878d None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:51.991781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:51.992414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:51.992689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:51.992986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.004530 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:52.011358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:52.012412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 128/274] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:52.013709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.062807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9369-07d9-4bcc-9b5c-60cdaadbeada None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.088050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:52.102573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:52.110046 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.110844 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.111270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.111704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.112985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.114555 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.116773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 147/275] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.117765 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.141312 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b97e-c4b0-4e30-89bf-60f8a8a659b8 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.186911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.187974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.188264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.188834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.189979 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.191710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.195130 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 129/276] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.195684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.228428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d177-013d-49f7-bfa5-3f25432261eb None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.264335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.265095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.265371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.265640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.266286 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:52.266580 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.267942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.280523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 148/277] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.280523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.311560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996274-e6ce-47d7-bdcf-9cb1a54fc80d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.332467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:52.343435 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:52.347715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.348521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.349521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.349984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.350791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.352400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.381271 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 130/278] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:30:52 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:52.382288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.393957 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb2a2-e126-4b73-b4da-d0442703c07b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.436352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.437435 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.437916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.438383 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.451407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:52.457571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:52.458531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:52.459340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:52.461822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 149/279] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:52.463014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.553285 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feede0b-5fc5-4079-9076-371b0b4212e5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.591477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.592414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.592954 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.593425 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.594370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] RBAC: Adding query filter params (role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=67b5e6dbdc87496b973923fc4eda5e01) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:52.594880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.596605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.601003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081843d0-4a7e-4db5-a7ae-ea577a956a02 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.604164 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 131/280] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/role_assignments?user.id=67b5e6dbdc87496b973923fc4eda5e01&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.605743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.627601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:52.651942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.652682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.653002 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.653282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] PATH_INFO: `/v3/users/c8ca2b45d77b4484b1c013c3f8f19df9` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.665316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:52.681095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] RBAC: Authorizing `identity:get_user(user_id=c8ca2b45d77b4484b1c013c3f8f19df9)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.683720 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.687102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 150/281] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/users/c8ca2b45d77b4484b1c013c3f8f19df9 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.694570 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.748839 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6906a4-1248-4440-b610-3fc6d3993852 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.792615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.793445 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.793796 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.794141 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.794905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:52.795282 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.796866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.807759 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 132/282] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.813747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:52.845468 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddb998-774d-4ca8-bd6e-62d8dfb9114d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.897010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:52.897932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:52.898390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:52.898875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:52.899764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, user.id=c8ca2b45d77b4484b1c013c3f8f19df9, scope.system=all) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:52.900248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:52.901905 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:52.909417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 151/283] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/role_assignments?user.id=c8ca2b45d77b4484b1c013c3f8f19df9&scope.system=all&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:52.962801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf454a-861a-4b29-a9d1-e5a97a01e46f None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:52.968889 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:53.019366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:53.019977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:53.020261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:53.020535 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] PATH_INFO: `/v3/users/92d31e591e3c47ca8cac0865c0a3783a` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:53.021952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] RBAC: Authorizing `identity:get_user(user_id=92d31e591e3c47ca8cac0865c0a3783a)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:53.023443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:53.025678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 133/284] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:52 2022] GET /identity/v3/users/92d31e591e3c47ca8cac0865c0a3783a => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:53.031507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:53.095825 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:53.170086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c5d3-3267-4122-9b88-6c9d7a4d58b4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:53.213968 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f4fa1-dda7-4a8a-a0e1-17840fbd973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:53.214613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f4fa1-dda7-4a8a-a0e1-17840fbd973d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:53.214893 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f4fa1-dda7-4a8a-a0e1-17840fbd973d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:53.215165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f4fa1-dda7-4a8a-a0e1-17840fbd973d None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:53.218271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f4fa1-dda7-4a8a-a0e1-17840fbd973d None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:53.219727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f4fa1-dda7-4a8a-a0e1-17840fbd973d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:53.221418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 152/285] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:53 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:53.229882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:53.418154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66df46-19fc-412a-8305-1313d664c720 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:53.476370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf85b-edf9-45dd-a2be-94fabd893c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:53.477051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf85b-edf9-45dd-a2be-94fabd893c97 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:53.477330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf85b-edf9-45dd-a2be-94fabd893c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:53.477601 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf85b-edf9-45dd-a2be-94fabd893c97 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/92d31e591e3c47ca8cac0865c0a3783a/roles/75c913ae91984e75a4755ca385ea7d80` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:53.482051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf85b-edf9-45dd-a2be-94fabd893c97 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8adffa42de46efb50aab220c9dfd70, user_id=92d31e591e3c47ca8cac0865c0a3783a, role_id=75c913ae91984e75a4755ca385ea7d80)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:53.483492 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf85b-edf9-45dd-a2be-94fabd893c97 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:53.508284 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 134/286] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:30:53 2022] PUT /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70/users/92d31e591e3c47ca8cac0865c0a3783a/roles/75c913ae91984e75a4755ca385ea7d80 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:54.444507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141a1a-df6b-4851-8b7a-6f8d1ec8e38d None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:54.445086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141a1a-df6b-4851-8b7a-6f8d1ec8e38d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:54.445086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141a1a-df6b-4851-8b7a-6f8d1ec8e38d None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:54.446664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 153/287] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:54.452193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:54.452630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:54.452726 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:54.478872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:54.480100 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:54.541489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:54.575755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 135/288] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:55.088966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141a1a-df6b-4851-8b7a-6f8d1ec8e38d None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:55.195230 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141a1a-df6b-4851-8b7a-6f8d1ec8e38d None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:55.230004 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:55.237621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:55.238254 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:55.238541 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:55.238811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:55.266096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:55.272183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:55.273618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:55.274927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 154/289] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:55.282009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:55.468571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9394-952d-4e2d-b436-2cf70d114c8d None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:55.506614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:55.507130 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:55.507402 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:55.507667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:55.508328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:55.508624 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:55.510061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:55.519604 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 136/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:55.530031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:55.700015 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990b39-120a-46ac-809e-8d9b2e5c566d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:55.748751 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cef96-af09-44ca-8cdc-1e568822fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:55.749695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cef96-af09-44ca-8cdc-1e568822fd42 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:55.750159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cef96-af09-44ca-8cdc-1e568822fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:55.750581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cef96-af09-44ca-8cdc-1e568822fd42 None admin] PATH_INFO: `/v3/users/4cca6860b31145abb6b848e1334fcd87` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:55.752198 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cef96-af09-44ca-8cdc-1e568822fd42 None admin] RBAC: Authorizing `identity:get_user(user_id=4cca6860b31145abb6b848e1334fcd87)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:55.754343 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cef96-af09-44ca-8cdc-1e568822fd42 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:55.757090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 155/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:55 2022] GET /identity/v3/users/4cca6860b31145abb6b848e1334fcd87 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:55.764496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:55.813093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:55.929043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d92377-5fd7-4817-a385-b24e2fb07040 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:56.014870 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2c2d7-4bdf-4aac-8a65-56185a8185ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:56.015878 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2c2d7-4bdf-4aac-8a65-56185a8185ac None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.016361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2c2d7-4bdf-4aac-8a65-56185a8185ac None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.017076 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2c2d7-4bdf-4aac-8a65-56185a8185ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.051477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a11f59-8e94-40d1-baf9-81ad5024a36f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.051894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a11f59-8e94-40d1-baf9-81ad5024a36f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.052125 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a11f59-8e94-40d1-baf9-81ad5024a36f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.053698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 156/292] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:56.058962 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8202-45e1-426c-abe6-2158d4d5d867 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.059247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8202-45e1-426c-abe6-2158d4d5d867 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.059536 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8202-45e1-426c-abe6-2158d4d5d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.091253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-93dd8202-45e1-426c-abe6-2158d4d5d867 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:56.092448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-93dd8202-45e1-426c-abe6-2158d4d5d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:56.131882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:56.138368 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2c2d7-4bdf-4aac-8a65-56185a8185ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:56.140754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2c2d7-4bdf-4aac-8a65-56185a8185ac None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:56.170749 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:56.182991 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 157/293] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:56.184262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007211b-c54f-487b-86ed-9d25444e8156 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.186228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007211b-c54f-487b-86ed-9d25444e8156 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.186228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007211b-c54f-487b-86ed-9d25444e8156 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.186228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 158/294] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:56.187390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86423792-ad96-4d80-bb2e-dd6516ad4b9f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.188826 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86423792-ad96-4d80-bb2e-dd6516ad4b9f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.188826 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86423792-ad96-4d80-bb2e-dd6516ad4b9f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.193232 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 159/295] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:56.194342 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.194553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.194799 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.219963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:56.221183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:56.286887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 137/296] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:56.288458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.288963 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.289453 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.316820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 160/297] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:30:56.316820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:56.320724 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:56.322384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:56.420693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:56.424500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d0f7-f920-4bac-aa0d-1be4a748a642 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:56.462323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:56.463044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.463391 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.463961 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.465016 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:56.466807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:56.468491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 161/298] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:56 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:56.474445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:56.514115 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 138/299] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:56.542000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:56.586021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf823a-3cc7-4fef-bece-f8601fbedaac None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:56.626667 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:56.627263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.627538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.627803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.628511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=4cca6860b31145abb6b848e1334fcd87) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:56.628827 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:56.630317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5cbc-c51f-4f5d-bebd-6b1dba7042de None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:56.644283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 162/300] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:56 2022] GET /identity/v3/role_assignments?user.id=4cca6860b31145abb6b848e1334fcd87&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:56.646265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea49d2-b7f3-44c0-aacf-f5ffad2bb43c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.646552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea49d2-b7f3-44c0-aacf-f5ffad2bb43c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.646886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea49d2-b7f3-44c0-aacf-f5ffad2bb43c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.652829 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 163/301] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:30:56.658687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.658989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.662067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.674480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:56.698875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:30:56.700087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:30:56.736701 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:56.750162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6184-045b-4964-90c7-0a0a66b2c26b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:56.795031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 164/302] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:30:56.795846 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:56.797268 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:56.798373 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:56.798849 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:56.800155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:56.815358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:56.822491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:56.823380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:56.824155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:56.826981 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 139/303] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:56.833001 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:56.962003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a200b7-7574-4dc5-9945-d9ac2dc64ac4 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:56.990856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952161-1dee-4f4d-acc0-46b9d193f11c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.006151 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.017555 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.018406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.018681 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.018964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.033775 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:57.034575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.035179 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.035457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.035728 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.038867 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:57.038867 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.038867 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:57.039220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:57.040043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:30:57.040958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 165/304] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:57.042044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.052734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 140/305] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:30:57.053398 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.068836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.160477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cdf74-1b0a-4b8c-9e98-3fbbe25155d1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.168522 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264cfc3-35e0-4a32-ac74-dcd55dcaf440 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.197460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.198091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.198371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.198645 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.199739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.201247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.202797 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 166/306] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.203551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.203781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.204390 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.204668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.204972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.205628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:57.205935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.207316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.215963 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 141/307] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.217697 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.251889 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.291982 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.305223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc27c5d-58dd-4cba-8d0a-7bab95039c92 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.319520 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d072-f3d7-454e-a1af-0018e032bb74 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.338466 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.339082 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.339354 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.339618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] PATH_INFO: `/v3/users/3381aaaa64cd44629b176049175b8d57` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.353288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.353906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.354180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.354447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.354536 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=3381aaaa64cd44629b176049175b8d57)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.355949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.357869 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 167/308] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/users/3381aaaa64cd44629b176049175b8d57 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.358615 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.365472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:30:57.370780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:30:57.371630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:30:57.372432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 142/309] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:30:57.373098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.463589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b477-640f-48be-94f5-83842f6d2eb4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.467699 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.474459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491f5c-ba9e-470b-a3b2-c6a7deefe058 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.498336 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.498932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.499212 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.499481 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] PATH_INFO: `/v3/groups` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.500089 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.501587 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.513615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.514242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.514797 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.514797 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] PATH_INFO: `/v3/users/c8ca2b45d77b4484b1c013c3f8f19df9` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.515898 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] RBAC: Authorizing `identity:get_user(user_id=c8ca2b45d77b4484b1c013c3f8f19df9)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.517381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.517482 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 168/310] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Sep 10 20:30:57 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:30:57.518258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.519118 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 143/311] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/users/c8ca2b45d77b4484b1c013c3f8f19df9 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.519996 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.534107 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.641526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667c5b-2212-45c9-bdef-7f871b72509e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.644002 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f3205-e4ea-4868-941e-6b41fb71a1f2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.681289 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.681522 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.681897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.682000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.682174 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.682267 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.682433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.682536 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.683139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:57.683243 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] RBAC: Adding query filter params (role.id=75c913ae91984e75a4755ca385ea7d80, user.id=3381aaaa64cd44629b176049175b8d57, scope.system=all) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:57.683443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.683533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.684905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.685021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.693244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 169/312] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/role_assignments?user.id=3381aaaa64cd44629b176049175b8d57&scope.system=all&role.id=75c913ae91984e75a4755ca385ea7d80 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.694520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.707901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 144/313] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.718078 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.762893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.812930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:57.864132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e2f7b-28eb-4589-a310-2fa79be7f767 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.871241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c1b30-606b-4958-97dc-19d1ae1e4eef None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:57.912177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.912177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.912177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.912524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] PATH_INFO: `/v3/users/92d31e591e3c47ca8cac0865c0a3783a` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.916140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] RBAC: Authorizing `identity:get_user(user_id=92d31e591e3c47ca8cac0865c0a3783a)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.917820 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.919465 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 145/314] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/users/92d31e591e3c47ca8cac0865c0a3783a => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:57.925630 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:57.931945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:57.932612 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:57.933397 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:57.933397 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] PATH_INFO: `/v3/system/users/c8ca2b45d77b4484b1c013c3f8f19df9/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:57.935171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8ca2b45d77b4484b1c013c3f8f19df9, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:57.936495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:57.948444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 170/315] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Sep 10 20:30:57 2022] PUT /identity/v3/system/users/c8ca2b45d77b4484b1c013c3f8f19df9/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:30:58.105381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b51d-00fd-41ea-9b50-660c67841222 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:58.116308 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:58.146058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:58.146810 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:58.147154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:58.147437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:58.233723 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:58.236550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:58.345213 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:30:58.357198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 146/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:30:58.359393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:58.475183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f821b2-7749-49c0-983e-4d21e5ffbaf9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:58.511120 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a868a1-f6c4-4ebd-a388-23fbcb17c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:58.512132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a868a1-f6c4-4ebd-a388-23fbcb17c255 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:58.512608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a868a1-f6c4-4ebd-a388-23fbcb17c255 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:58.513152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a868a1-f6c4-4ebd-a388-23fbcb17c255 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:58.514509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a868a1-f6c4-4ebd-a388-23fbcb17c255 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:58.516170 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a868a1-f6c4-4ebd-a388-23fbcb17c255 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:58.523027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 171/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:30:58 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:30:58.524615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:30:58.627678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ca98-82cb-4f33-80ea-f1ef69508f2c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:30:58.665536 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:30:58.666501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:30:58.666976 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:30:58.667458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:30:58.668447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] RBAC: Adding query filter params (role.id=75c913ae91984e75a4755ca385ea7d80, scope.project.id=2e8adffa42de46efb50aab220c9dfd70, user.id=92d31e591e3c47ca8cac0865c0a3783a) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:30:58.669031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:30:58.670780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122721d6-54cd-4a0e-a6d6-743f311ef831 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:30:58.678197 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 147/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:30:58 2022] GET /identity/v3/role_assignments?user.id=92d31e591e3c47ca8cac0865c0a3783a&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=75c913ae91984e75a4755ca385ea7d80 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:00.169542 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814faa0-b05d-4538-8c2f-a2c17cb660c9 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.170063 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814faa0-b05d-4538-8c2f-a2c17cb660c9 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.170063 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814faa0-b05d-4538-8c2f-a2c17cb660c9 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.171480 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 172/319] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:00.177592 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dda7a-9dce-42be-9fc1-a1219e581767 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.178093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dda7a-9dce-42be-9fc1-a1219e581767 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.178177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dda7a-9dce-42be-9fc1-a1219e581767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.200661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-ce5dda7a-9dce-42be-9fc1-a1219e581767 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:00.201944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-ce5dda7a-9dce-42be-9fc1-a1219e581767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:00.274954 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:00.291043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 148/320] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:00.331524 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97a4b-cdcb-44b7-989c-f6b5f3398a52 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.331847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97a4b-cdcb-44b7-989c-f6b5f3398a52 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.332069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97a4b-cdcb-44b7-989c-f6b5f3398a52 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.333560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 173/321] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:00.338902 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3dcb-ee31-44ee-9fc2-07bbc5667909 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.339415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3dcb-ee31-44ee-9fc2-07bbc5667909 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.339892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3dcb-ee31-44ee-9fc2-07bbc5667909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.358711 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-b89d3dcb-ee31-44ee-9fc2-07bbc5667909 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:00.360278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-b89d3dcb-ee31-44ee-9fc2-07bbc5667909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:00.445108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 149/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:00.628190 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97a4b-cdcb-44b7-989c-f6b5f3398a52 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:00.631319 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:00.658051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7409df-abc6-4e96-9529-6cc56b5d4324 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.658371 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7409df-abc6-4e96-9529-6cc56b5d4324 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.658606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7409df-abc6-4e96-9529-6cc56b5d4324 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.660060 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 150/323] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:00.665532 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.665842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.666160 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.698728 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:00.700953 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:00.772963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97a4b-cdcb-44b7-989c-f6b5f3398a52 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:00.803496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 151/324] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:00.804469 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:00.811169 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:00.812045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:00.812517 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:00.813007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:00.814103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:00.815547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:00.818109 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 174/325] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:00.827201 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:00.882535 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:00.910418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:00.950618 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74335c49-a93d-4140-be0b-90feb24de6e0 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:00.955163 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526f8b0-649a-4f0d-bf72-b67905ec3b80 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.006515 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.007145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.007422 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.007690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.013267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.014321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.014586 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.014857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] PATH_INFO: `/v3/groups` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.015486 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:01.016969 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:01.019227 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:01.025450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:01.026417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:01.027278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 152/326] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:01.033021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:01.049300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 175/327] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Sep 10 20:31:00 2022] POST /identity/v3/groups => generated 226 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:31:01.135739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:01.167832 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbf48-230b-4cdc-b378-4adcc0ceb4c7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.182261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:01.216635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.217310 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.217592 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.218152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.219020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:01.219329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:01.221164 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:01.233570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 153/328] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:01.245258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:01.307832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387d2a-335c-4e73-b488-3b5302f898f9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.354017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:01.369118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.369328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.370427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.370427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.384941 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745850-69b1-4ca0-9ed1-4c1450370d04 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.389843 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:01.396725 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:01.397757 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:01.398554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:01.399200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 176/329] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:01.407417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:01.451114 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.452122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.452657 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.453240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] PATH_INFO: `/v3/users/3381aaaa64cd44629b176049175b8d57` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.455826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] RBAC: Authorizing `identity:get_user(user_id=3381aaaa64cd44629b176049175b8d57)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:01.457542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:01.462735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 154/330] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:31:01 2022] GET /identity/v3/users/3381aaaa64cd44629b176049175b8d57 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:01.470855 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:01.539044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:01.595589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101488db-6080-40ac-9067-39ddb2a35fe6 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.635177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4e6d6-ef2a-4bf7-a45f-33e1c1fecbb9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.638209 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.641603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.641603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.641603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.641603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:01.641603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:01.644811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:01.659054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 177/331] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:01.666528 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:01.681510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.682264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.682546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.682821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] PATH_INFO: `/v3/system/users/3381aaaa64cd44629b176049175b8d57/roles/75c913ae91984e75a4755ca385ea7d80` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.684407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3381aaaa64cd44629b176049175b8d57, role_id=75c913ae91984e75a4755ca385ea7d80)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:01.685998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:01.699986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 155/332] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Sep 10 20:31:01 2022] PUT /identity/v3/system/users/3381aaaa64cd44629b176049175b8d57/roles/75c913ae91984e75a4755ca385ea7d80 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:01.762156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:01.874575 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbc03d-8271-449b-8fdc-50157ccba52a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:01.923402 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed356e23-a6af-4b77-83e9-da19258cfc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:01.923976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356e23-a6af-4b77-83e9-da19258cfc2d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:01.924253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356e23-a6af-4b77-83e9-da19258cfc2d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:01.924523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356e23-a6af-4b77-83e9-da19258cfc2d None admin] PATH_INFO: `/v3/users/c8ca2b45d77b4484b1c013c3f8f19df9` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:01.925717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed356e23-a6af-4b77-83e9-da19258cfc2d None admin] RBAC: Authorizing `identity:get_user(user_id=c8ca2b45d77b4484b1c013c3f8f19df9)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:01.927253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed356e23-a6af-4b77-83e9-da19258cfc2d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:01.928893 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 178/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:31:01 2022] GET /identity/v3/users/c8ca2b45d77b4484b1c013c3f8f19df9 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:01.936822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:02.098366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157a75-0294-410c-9e0b-72aecb0502bb None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:02.100498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:02.144437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:02.145073 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:02.145884 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:02.146243 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:02.147244 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] RBAC: Adding query filter params (role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, user.id=c8ca2b45d77b4484b1c013c3f8f19df9, scope.system=all) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:02.147347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:02.148835 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bce82-3412-4632-a30a-aa7fedabefff None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:02.168012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 156/334] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 10 20:31:01 2022] GET /identity/v3/role_assignments?user.id=c8ca2b45d77b4484b1c013c3f8f19df9&scope.system=all&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:04.605544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807614b7-4c42-49eb-8b69-d7a31326f4f1 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:04.606070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807614b7-4c42-49eb-8b69-d7a31326f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:04.606070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807614b7-4c42-49eb-8b69-d7a31326f4f1 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:04.608475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 179/335] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:04.616710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0f5d-0da4-4d9a-aa38-9fe4bb63d098 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:04.616710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0f5d-0da4-4d9a-aa38-9fe4bb63d098 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:04.616710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0f5d-0da4-4d9a-aa38-9fe4bb63d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:04.646586 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-48ed0f5d-0da4-4d9a-aa38-9fe4bb63d098 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:04.648167 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-48ed0f5d-0da4-4d9a-aa38-9fe4bb63d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:04.770427 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 157/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:05.334442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4dc5-583f-43e6-bdb2-149d8bf7d7af None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.336314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4dc5-583f-43e6-bdb2-149d8bf7d7af None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.336314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4dc5-583f-43e6-bdb2-149d8bf7d7af None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.336767 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 180/337] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:05.349678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16d93-ad64-4dbe-af99-ca4839f554ad None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.349966 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16d93-ad64-4dbe-af99-ca4839f554ad None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.350245 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16d93-ad64-4dbe-af99-ca4839f554ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.374613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4dc5-583f-43e6-bdb2-149d8bf7d7af None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:05.377473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-34a16d93-ad64-4dbe-af99-ca4839f554ad None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:05.378415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-34a16d93-ad64-4dbe-af99-ca4839f554ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:05.534659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 158/338] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:05.579176 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae8c80-942e-4c58-94a7-99eb47c2532d None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.579707 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae8c80-942e-4c58-94a7-99eb47c2532d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.580145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae8c80-942e-4c58-94a7-99eb47c2532d None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.585476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 159/339] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:05.592695 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9848d4-3652-43e1-8bfa-ba5f7f391b42 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.593561 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9848d4-3652-43e1-8bfa-ba5f7f391b42 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.594036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9848d4-3652-43e1-8bfa-ba5f7f391b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.639922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-8c9848d4-3652-43e1-8bfa-ba5f7f391b42 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:05.642064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-8c9848d4-3652-43e1-8bfa-ba5f7f391b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:05.672020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:05.681512 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4dc5-583f-43e6-bdb2-149d8bf7d7af None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:05.737195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:05.762035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a438e86-9549-4fcd-9485-be14091cf16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:05.762684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a438e86-9549-4fcd-9485-be14091cf16b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.762988 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a438e86-9549-4fcd-9485-be14091cf16b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.763262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a438e86-9549-4fcd-9485-be14091cf16b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.785975 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a438e86-9549-4fcd-9485-be14091cf16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-4a438e86-9549-4fcd-9485-be14091cf16b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:05.791443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:05.792338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:05.793927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 181/340] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:31:05.794579 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca14fb-c85b-4844-9b9d-33fd78aa5687 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.794579 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca14fb-c85b-4844-9b9d-33fd78aa5687 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.794695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca14fb-c85b-4844-9b9d-33fd78aa5687 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.795825 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 182/341] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:05.800306 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca14fb-c85b-4844-9b9d-33fd78aa5687 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:05.807541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 160/342] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:05.808825 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:05.809119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:05.809400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:05.853945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:05.855693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:06.069936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 161/343] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:06.071247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:06.107258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca14fb-c85b-4844-9b9d-33fd78aa5687 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:06.218679 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:06.219819 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:06.220318 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:06.220821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:06.221702 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:06.222450 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:06.224660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:06.252998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 183/344] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:06.259566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:06.274554 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:06.301749 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881951-4d37-49aa-a221-81881ff37de6 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:06.366028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:06.366888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:06.367306 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:06.368812 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:06.385375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:06.394430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:06.405472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:06.406493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:06.407366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:06.409635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 162/345] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:31:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:06.416435 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:06.534365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd7fdb-c85c-477d-8224-bee4ce18839c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:06.568243 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13094f-c77d-43cd-ae6f-d998e6d182fe None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:06.581379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:06.581870 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:06.582149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:06.582507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:06.610518 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:06.611377 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:06.611777 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:06.612184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:06.614374 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:06.614906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:06.616565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:06.628512 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 163/346] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:06.634446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:06.640159 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:06.674248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:06.675755 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:06.728912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:06.809456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173263-6ecd-4d6f-93ce-84cfbdfe1165 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:06.853711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 184/347] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:06.854581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:06.884937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:06.885398 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:06.885864 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:06.886336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:06.906740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:06.912480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:06.913454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:06.914276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 164/348] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:06.915502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:06.995292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e76238-d6db-4192-a61f-79797bf82dad None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.027472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:07.045393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.046175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.046514 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.046736 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.074532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:07.083139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:07.084032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:07.084916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:07.086160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 185/349] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:07.086861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:07.093220 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917d0d-cf04-45ed-8a57-cf5420b34f4d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.094994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:07.155599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f755b-1463-4f9e-9c36-d62b8fc3acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.157006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f755b-1463-4f9e-9c36-d62b8fc3acbb None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.158206 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f755b-1463-4f9e-9c36-d62b8fc3acbb None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.159537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f755b-1463-4f9e-9c36-d62b8fc3acbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.264590 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de33c4e-f55a-44a2-874b-de866e7ba1ef None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.273928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f755b-1463-4f9e-9c36-d62b8fc3acbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:07.275431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f755b-1463-4f9e-9c36-d62b8fc3acbb None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:07.313954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.314744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.315032 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.315306 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.318996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:07.320993 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:07.322538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 186/350] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:07 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:07.323754 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:07.359090 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:07.423886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:07.427941 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 165/351] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:07.430358 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31a49-f7cb-4de4-b275-94c626b582bd None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.430475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31a49-f7cb-4de4-b275-94c626b582bd None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.430722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31a49-f7cb-4de4-b275-94c626b582bd None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.432940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 166/352] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:07.432940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31a49-f7cb-4de4-b275-94c626b582bd None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:07.469715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c2ed0-973c-4401-9a3d-b05387f8823f None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.519014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.519751 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.520828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.520950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.523660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] RBAC: Adding query filter params (name=reader) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:07.524052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:07.525551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57b05-0a67-4553-b389-0f14abff3eae None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:07.542537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 187/353] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:07.545113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df31c-0928-4899-9300-715d277e04b2 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.546796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df31c-0928-4899-9300-715d277e04b2 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.547961 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df31c-0928-4899-9300-715d277e04b2 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.549374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 188/354] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:07.550991 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df31c-0928-4899-9300-715d277e04b2 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:07.608286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31a49-f7cb-4de4-b275-94c626b582bd None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.665100 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.666484 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.666942 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.667221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.667907 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:07.668212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:07.669643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:07.681894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 167/355] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:07.682522 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:07.698104 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df31c-0928-4899-9300-715d277e04b2 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.722102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:07.749240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:07.762547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0b71-f2fa-4135-823b-57cb0ba4c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.763644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0b71-f2fa-4135-823b-57cb0ba4c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.763942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0b71-f2fa-4135-823b-57cb0ba4c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.764226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0b71-f2fa-4135-823b-57cb0ba4c8d9 None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.771556 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e0b71-f2fa-4135-823b-57cb0ba4c8d9 None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:07.772833 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e0b71-f2fa-4135-823b-57cb0ba4c8d9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:07.781981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 189/356] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:07 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:07.781981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8edf8-081c-422f-8e16-4b6969aab644 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.781981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8edf8-081c-422f-8e16-4b6969aab644 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.781981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8edf8-081c-422f-8e16-4b6969aab644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.804310 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-72f8edf8-081c-422f-8e16-4b6969aab644 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:07.805879 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-72f8edf8-081c-422f-8e16-4b6969aab644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:07.840529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec5718-217c-4779-9e08-dc33c5313c78 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:07.896122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:07.896701 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.897013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.897285 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.898940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:07.900399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:07.902116 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 168/357] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:07 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:07.902954 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:07.908923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 190/358] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:07.908923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:07.908923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:07.908923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:07.933584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:07.935113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:08.040696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 191/359] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:08.041947 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.073351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:08.092814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40da4bd-4cb8-47fa-a238-8c16f91f1712 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:08.139526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:08.145315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:08.145315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:08.145315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] PATH_INFO: `/v3/users/3381aaaa64cd44629b176049175b8d57` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:08.148811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=3381aaaa64cd44629b176049175b8d57)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:08.148811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:08.150985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 169/360] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 10 20:31:07 2022] GET /identity/v3/users/3381aaaa64cd44629b176049175b8d57 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:08.151946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.159696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:08.212629 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6c59f-19a0-4e45-a106-33a0bbb363db None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:08.253913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:08.254558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:08.254957 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:08.255301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:08.283495 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34763-1b47-4750-ad65-56a5a0366cd4 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:08.335037 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:08.335653 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:08.335931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:08.336407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:08.336956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=0a25fef9086f400895e3834cc2bc7398) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:08.337349 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:08.338701 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:08.343414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:08.345793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 170/361] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:08.345793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.346562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:08.394077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:08.426023 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:08.495853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 192/362] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:08.496680 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.533070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a8984-4fc4-44f5-abfa-d695314cd28b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:08.607053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:08.608235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:08.608432 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:08.609365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:08.612027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:08.614542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:08.618209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 171/363] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:08.618209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.676030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905660b-d7fe-4a43-b0fb-53cc0dfefba4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:08.716066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:08.716759 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:08.717075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:08.717347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:08.718067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] RBAC: Adding query filter params (role.id=75c913ae91984e75a4755ca385ea7d80, user.id=3381aaaa64cd44629b176049175b8d57, scope.system=all) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:08.718372 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:08.719807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:08.740816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 193/364] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/role_assignments?user.id=3381aaaa64cd44629b176049175b8d57&scope.system=all&role.id=75c913ae91984e75a4755ca385ea7d80 => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:08.740816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.762263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:08.764061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:08.778431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188542-6ca4-42f3-a59b-c867600b6bac None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:08.844677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:08.848277 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:08.848277 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:08.848277 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:08.870384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:08.882017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:08.882972 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:08.883758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:08.888098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 172/365] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:08.888098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:08.951171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6446-afdd-4cb5-ba38-158d9b9e209e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.027256 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.028115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.028342 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.028708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.043496 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:09.051673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:09.052592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:09.054008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 194/366] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:09.054691 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137336-51f5-4a54-8761-d3b8a5966a17 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.054764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:09.126871 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.127884 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.128376 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.129061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.131180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.136253 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:09.137830 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 173/367] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:08 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:09.139401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:09.183238 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:09.187124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:09.234518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc467106-ee26-40df-9d91-31c47228dd5c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.286044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.287188 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.287668 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.288491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.289721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=0a25fef9086f400895e3834cc2bc7398) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:09.290179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.291763 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:09.301411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 195/368] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:09 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:09.302653 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:09.328222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f80f8-ca98-438f-9265-2a5f54d1f341 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.375449 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.376158 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.376755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.376893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.378605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:09.378905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.383708 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:09.395279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 174/369] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:09.396306 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:09.475244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549666-3379-412d-b926-d0b93d7b6f49 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.520382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:09.528337 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.529357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.530417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.530893 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.531786 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:09.532340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.534316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:09.546945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:09.555962 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 196/370] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:09.560782 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941664f-fe3c-474b-a3e4-2ea2b47185cf None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.562091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:09.617729 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.618807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.619411 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.619865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.621221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.623084 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:09.625426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 175/371] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:09 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:09.626410 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:09.734884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8bcac-4e0e-48dd-9cf5-6db699d7f711 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.754444 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489103-97ef-4f34-83ca-b672d93bdfbc None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:09.796037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.796723 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.797041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.799987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.802651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:09.804049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:09.804685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:09.805205 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:09.834301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:09.904977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.908498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:09.910849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:09.921229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:09.922938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.033171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 176/372] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:10.034262 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.089505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 197/373] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:10.092468 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.111180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:10.178615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bed6-8eda-445e-a19e-7b0cc4af0ad5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.218273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.218881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.219158 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.219429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.220143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=2e8adffa42de46efb50aab220c9dfd70) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:10.220457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.221933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.229236 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 177/374] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:10.230049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.242217 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:10.248552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad9a41-3f06-48b6-9c05-5c14b73c6f22 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.324783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.326019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.326501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.326995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] PATH_INFO: `/v3/projects/13b9411a439646919a95885e1ed2dcbc` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.333807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] RBAC: Authorizing `identity:get_project(project_id=13b9411a439646919a95885e1ed2dcbc)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.335640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.338061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 198/375] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/projects/13b9411a439646919a95885e1ed2dcbc => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:10.347377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.377892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56e3d-cc33-45ba-9bfb-a0c28fcfbb58 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.393682 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:10.420558 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.421317 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.421531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.421810 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.428848 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.428848 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.428848 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 178/376] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:10.439400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.568537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317371f9-40d8-4efc-9b57-cace7d3b0475 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.593807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2d39-04bb-4b83-b460-af26a90406ac None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.618220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.618954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.619324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.619690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] PATH_INFO: `/v3/groups/473cbbc9843040829d94102b1193ae4f` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.627043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] RBAC: Authorizing `identity:get_group(group_id=473cbbc9843040829d94102b1193ae4f)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.628764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.632003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 199/377] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/groups/473cbbc9843040829d94102b1193ae4f => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:10.638365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.653498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.654779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.655268 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.655744 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.659132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.662979 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.666542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 179/378] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:10.673941 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:10.680373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:10.733938 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:10.766799 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9948891-6cbe-407e-97a1-8c8d1209dd87 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.805452 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.806870 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.807331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.807773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.808867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] RBAC: Adding query filter params (group.id=473cbbc9843040829d94102b1193ae4f, role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=13b9411a439646919a95885e1ed2dcbc) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:10.810978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.813139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2d9da-4969-4c00-a6a2-66a8bbcdeef3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.819957 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 200/379] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/role_assignments?group.id=473cbbc9843040829d94102b1193ae4f&scope.project.id=13b9411a439646919a95885e1ed2dcbc&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:10.825081 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6b4c-9d84-4681-bfff-6b9101f5ba48 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:10.900595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:10.901710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:10.902218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:10.902686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:10.903611 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=2e8adffa42de46efb50aab220c9dfd70) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:10.904118 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:10.912715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093f966-8d19-4156-9356-b071fd528236 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:10.927396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 180/380] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:10 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:11.228011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea345d-08ab-4f77-8814-c64ac4b76cb2 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:11.228313 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea345d-08ab-4f77-8814-c64ac4b76cb2 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:11.228499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea345d-08ab-4f77-8814-c64ac4b76cb2 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:11.230021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 201/381] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:11.235847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:11.236148 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:11.236386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:11.268999 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:11.270757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:11.360552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 181/382] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:11.725527 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea345d-08ab-4f77-8814-c64ac4b76cb2 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:11.890254 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:11.897533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea345d-08ab-4f77-8814-c64ac4b76cb2 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:11.983221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:11.983791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:11.984064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:11.984330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:12.011247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:12.022051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:12.022910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:12.024338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 202/383] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:12.029234 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:12.125324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:12.241762 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e39a6-68d8-4d31-92da-920dd17d3bae None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:12.306059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:12.307068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:12.307356 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:12.307632 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:12.308840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] RBAC: Adding query filter params (name=member) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:12.309151 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:12.310532 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10898fca-51f8-4d6c-9c90-8b8e90c9a965 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:12.323067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 182/384] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:12.330045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:12.577744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec3e6-505e-4e54-8b35-cd39e2f5de35 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:12.619290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c554-b646-49ee-87da-275a0603e0bb None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:12.619637 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c554-b646-49ee-87da-275a0603e0bb None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:12.619835 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c554-b646-49ee-87da-275a0603e0bb None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:12.621510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 183/385] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:12.634400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:12.634698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:12.634986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:12.658124 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:12.658766 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:12.659044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:12.659339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:12.660531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:12.662003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:12.664171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 203/386] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:12 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:12.670532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:12.699288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:12.700488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:12.738914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:12.862985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 184/387] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:12.866180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97614b9f-f7ec-49cf-a1bb-0289f8026a05 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:12.908271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:12.909087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:12.909250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:12.909519 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:12.910761 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:12.912371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:12.914896 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 204/388] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:12 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:12.920436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:13.005160 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:13.151050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed6ac0-76d9-45d0-bdaf-099f5fb8740a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:13.253490 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ad5c2-52cb-4ed5-921f-7d1648946b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:13.255082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ad5c2-52cb-4ed5-921f-7d1648946b66 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:13.255561 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ad5c2-52cb-4ed5-921f-7d1648946b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:13.256029 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ad5c2-52cb-4ed5-921f-7d1648946b66 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398/groups/69b6c25d413d4433900bf99829d162a8/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:13.258209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ad5c2-52cb-4ed5-921f-7d1648946b66 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a25fef9086f400895e3834cc2bc7398, group_id=69b6c25d413d4433900bf99829d162a8, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:13.259858 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ad5c2-52cb-4ed5-921f-7d1648946b66 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:13.287194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 185/389] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 10 20:31:12 2022] PUT /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398/groups/69b6c25d413d4433900bf99829d162a8/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:13.514927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:13.653884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:13.666756 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fff2a-94fc-4032-91c6-a6924a53b299 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:13.706387 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087696d-5365-430a-aba7-cee044e8c5a6 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:13.706713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087696d-5365-430a-aba7-cee044e8c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:13.707398 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087696d-5365-430a-aba7-cee044e8c5a6 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:13.717447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 186/390] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:13.718267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:13.719188 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:13.719680 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:13.720164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:13.723504 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:13.723789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:13.724066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:13.734336 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:13.742713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:13.743608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:13.744417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 205/391] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:31:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:13.750227 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:13.791436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:13.797078 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:13.923636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a66e26-3d70-4770-8b4e-776e364c1cc8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:14.016554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:14.017281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.020809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.020809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.020809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:14.020809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:14.020809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a2738-0111-48d6-8a0b-0b3edd624d5b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:14.026017 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 187/392] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:14.035694 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 206/393] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:14.044881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:14.112813 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:14.339010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5b84d-c25f-4dd7-a1e1-298755073fed None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:14.375666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386f7be-fe68-4855-b56e-5b68695323b8 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.375951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386f7be-fe68-4855-b56e-5b68695323b8 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.376225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386f7be-fe68-4855-b56e-5b68695323b8 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.377997 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 207/394] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:14.383294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a2ed8-e10b-4e52-9e8c-0cec5f201e37 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.383703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a2ed8-e10b-4e52-9e8c-0cec5f201e37 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.384132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a2ed8-e10b-4e52-9e8c-0cec5f201e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.432012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a35ee-5ba9-4db4-a34c-d2e67f9a5bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:14.434399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-390a2ed8-e10b-4e52-9e8c-0cec5f201e37 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:14.435319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a35ee-5ba9-4db4-a34c-d2e67f9a5bde None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.436717 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a35ee-5ba9-4db4-a34c-d2e67f9a5bde None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.438212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a35ee-5ba9-4db4-a34c-d2e67f9a5bde None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.439218 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-390a2ed8-e10b-4e52-9e8c-0cec5f201e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:14.443421 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a35ee-5ba9-4db4-a34c-d2e67f9a5bde None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:14.454141 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a35ee-5ba9-4db4-a34c-d2e67f9a5bde None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:14.463342 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 188/395] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:14 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:14.464748 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f98e-22c8-44fe-967d-3fec9f5067ea None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.465085 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f98e-22c8-44fe-967d-3fec9f5067ea None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.465361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f98e-22c8-44fe-967d-3fec9f5067ea None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.466815 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 189/396] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:14.468586 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f98e-22c8-44fe-967d-3fec9f5067ea None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:14.492814 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:14.596208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 208/397] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:14.610152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.610443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.610720 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.665609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:14.672784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:14.674309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:14.680022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f98e-22c8-44fe-967d-3fec9f5067ea None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:14.724209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:14.725912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.726371 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.726819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.728259 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:14.730498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:14.733167 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 190/398] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:14 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:14.734226 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:14.756322 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 209/399] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:14.764408 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:14.873391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb19f6-0793-4393-a448-dbf13dc9275e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:14.921340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:14.921962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:14.922238 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:14.922505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:14.933176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:14.940670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:14.947016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:14.947880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:14.949121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 191/400] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:14.949771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:14.967149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c70b4-21f6-4416-9d53-d920d8a4570c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:14.992376 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:15.015051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.016957 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.017589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.018115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398/groups/69b6c25d413d4433900bf99829d162a8/roles/600c5bd8ce74469bb32ebbd74ce125cc` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.023577 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a25fef9086f400895e3834cc2bc7398, group_id=69b6c25d413d4433900bf99829d162a8, role_id=600c5bd8ce74469bb32ebbd74ce125cc)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.023577 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.044814 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 210/401] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 10 20:31:14 2022] PUT /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398/groups/69b6c25d413d4433900bf99829d162a8/roles/600c5bd8ce74469bb32ebbd74ce125cc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:15.050027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.151175 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2b0ba-58ab-46cd-835d-c84e224080aa None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.201253 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.202240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.202521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.202795 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.218973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:15.225608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:15.226543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:15.227329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:15.234711 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 192/402] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:31:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:15.234901 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bbea-62d1-45d4-8682-88e097afd222 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.236393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.274616 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.275220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.275498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.275769 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.276424 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:15.276724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.278180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.279576 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:15.293320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 211/403] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:15.293508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.337089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:15.366455 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b696-06e7-4165-809a-da0ab91db59e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.401580 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.402127 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.402407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.402707 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.409294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce19b10-0f4d-44a8-bef0-e9c65dcc9fba None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.420618 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:15.427633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:15.428501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:15.429661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:15.432933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 193/404] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:15.434026 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.449454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.450076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.450350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.450619 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.451322 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:15.451625 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.453130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.461855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 212/405] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:15.462510 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.565163 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:15.567842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748cb2-6f99-4cb7-b0a4-1991ee3b3b7a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.582835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934362-4297-49e1-84a6-95c832284f1f None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.609903 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.610533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.610810 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.611079 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.613527 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.615320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.622198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 194/406] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:15.622198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.631100 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.631963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.632444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.632945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.633815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:15.634332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.636050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.639294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:15.651685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 213/407] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:15.652874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.758635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b40e-185c-4edc-aa48-707af6eadbe9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.787010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ffd5-54ad-4b96-b8fc-1faf7c6cda8a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:15.816270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:15.837256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.837910 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.838196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.838431 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:15.838546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.839373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:15.840042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:15.840525 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:15.841978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.842430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:15.843923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.844033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:15.851352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 214/408] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:15.851698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 195/409] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:15.852595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.853159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:15.963834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:16.018805 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52893-1b8c-4e79-898b-d08f888bf270 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:16.038603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839fd6-96b2-4251-86c4-e2ac51d8bd5d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:16.085562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:16.086406 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.086944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.087323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.090809 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:16.091185 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:16.093399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 196/410] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:16.093980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:16.103101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:16.104028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.104499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.104993 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] PATH_INFO: `/v3/groups/473cbbc9843040829d94102b1193ae4f` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.106299 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] RBAC: Authorizing `identity:get_group(group_id=473cbbc9843040829d94102b1193ae4f)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:16.108242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:16.110385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 215/411] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:15 2022] GET /identity/v3/groups/473cbbc9843040829d94102b1193ae4f => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:16.115088 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:16.217258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:16.230911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9b52-533e-437f-a936-c7c975c1dfba None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:16.262201 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0225b9-d298-40bf-9315-561a7d42ae34 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:16.281791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:16.282458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.282742 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.283464 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70/groups/69b6c25d413d4433900bf99829d162a8/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.286020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8adffa42de46efb50aab220c9dfd70, group_id=69b6c25d413d4433900bf99829d162a8, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:16.287483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:16.299953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1978d5-4a6c-49c8-bcfd-353fe5134069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:16.301445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1978d5-4a6c-49c8-bcfd-353fe5134069 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.301891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1978d5-4a6c-49c8-bcfd-353fe5134069 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.302260 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 197/412] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 10 20:31:16 2022] PUT /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70/groups/69b6c25d413d4433900bf99829d162a8/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:16.302439 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1978d5-4a6c-49c8-bcfd-353fe5134069 None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70/groups/69b6c25d413d4433900bf99829d162a8/roles/600c5bd8ce74469bb32ebbd74ce125cc` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.303082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:16.305067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1978d5-4a6c-49c8-bcfd-353fe5134069 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8adffa42de46efb50aab220c9dfd70, group_id=69b6c25d413d4433900bf99829d162a8, role_id=600c5bd8ce74469bb32ebbd74ce125cc)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:16.307931 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1978d5-4a6c-49c8-bcfd-353fe5134069 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:16.313360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:16.331635 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 216/413] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 10 20:31:16 2022] PUT /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70/groups/69b6c25d413d4433900bf99829d162a8/roles/600c5bd8ce74469bb32ebbd74ce125cc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:16.333855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f8c41-298b-415a-84ea-8ac5fb3b5296 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.334316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f8c41-298b-415a-84ea-8ac5fb3b5296 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.334776 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f8c41-298b-415a-84ea-8ac5fb3b5296 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.336886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 217/414] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:16.342365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.342995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.343535 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.367889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:16.369587 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:16.459294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 218/415] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:16.518417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c440-c29e-4098-9fb7-726d4215d137 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:16.575172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:16.575840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.576124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.576403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] PATH_INFO: `/v3/projects/13b9411a439646919a95885e1ed2dcbc` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.577635 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] RBAC: Authorizing `identity:get_project(project_id=13b9411a439646919a95885e1ed2dcbc)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:16.579134 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:16.581205 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 198/416] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:16 2022] GET /identity/v3/projects/13b9411a439646919a95885e1ed2dcbc => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:16.587248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:16.643185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:16.711239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927dce5-cbea-4360-aa00-ccb400b82dac None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:16.748743 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089899-42e9-4172-9247-2f151813b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:16.749720 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089899-42e9-4172-9247-2f151813b506 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:16.750206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089899-42e9-4172-9247-2f151813b506 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:16.750654 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089899-42e9-4172-9247-2f151813b506 None admin] PATH_INFO: `/v3/projects/13b9411a439646919a95885e1ed2dcbc/groups/473cbbc9843040829d94102b1193ae4f/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:16.752824 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089899-42e9-4172-9247-2f151813b506 None admin] RBAC: Authorizing `identity:create_grant(project_id=13b9411a439646919a95885e1ed2dcbc, group_id=473cbbc9843040829d94102b1193ae4f, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:16.754612 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089899-42e9-4172-9247-2f151813b506 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:16.776818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 219/417] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 10 20:31:16 2022] PUT /identity/v3/projects/13b9411a439646919a95885e1ed2dcbc/groups/473cbbc9843040829d94102b1193ae4f/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:16.812780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:16.939468 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:16.979943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00df8-f2b9-403e-89c2-9d6299512ffd None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:17.030510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:17.031070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:17.031341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:17.031619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:17.044870 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:17.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:17.050575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:17.051364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 199/418] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:17.059155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089899-42e9-4172-9247-2f151813b506 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:17.202969 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089899-42e9-4172-9247-2f151813b506 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:17.211628 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:17.239760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:17.240362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:17.240640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:17.240961 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:17.241614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:17.241915 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:17.243450 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:17.258228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 220/419] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:17.263864 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:17.399736 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9f98-0f31-4745-8a65-7810fc90a260 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:17.446475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46db0-45e2-43e1-bff4-888e423e26b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:17.447085 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46db0-45e2-43e1-bff4-888e423e26b9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:17.447365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46db0-45e2-43e1-bff4-888e423e26b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:17.447638 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46db0-45e2-43e1-bff4-888e423e26b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:17.454861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:17.539974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46db0-45e2-43e1-bff4-888e423e26b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:17.541468 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46db0-45e2-43e1-bff4-888e423e26b9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:17.681818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 200/420] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:17.687400 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:17.795140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe1eb-c16c-4d0d-b337-5cceac8154ca None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:17.795650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe1eb-c16c-4d0d-b337-5cceac8154ca None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:17.795957 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe1eb-c16c-4d0d-b337-5cceac8154ca None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:17.797335 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 201/421] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:17.804349 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:17.804642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:17.804952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:17.827000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:17.828478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:17.840723 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bbced-739e-4c18-882d-7bb05b1267f3 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:17.869139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:17.903894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:17.904518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:17.904822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:17.905094 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:17.906912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:17.908359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:17.910392 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 221/422] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:17 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:17.916261 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:17.948849 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 202/423] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:17.972185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:18.045451 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f767ba3-fc73-40b8-afa2-5f521274c4b2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:18.104696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:18.105337 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:18.105628 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:18.105904 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:18.107071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:18.108595 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:18.110517 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 222/424] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:17 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:18.116857 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:18.250851 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec79c5-a844-47f7-a4f5-69d5bb6de188 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:18.298856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:18.299462 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:18.299743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:18.300018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:18.300733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=0a25fef9086f400895e3834cc2bc7398) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:18.301074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:18.302519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:18.313390 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 203/425] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:18 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:18.534350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:18.655436 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078175a3-db66-4d7d-b9db-e2a37b4f3bac None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:18.657852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:18.690158 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:18.690781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:18.691155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:18.691430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:18.701978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:18.707838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:18.708710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:18.709552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 223/426] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:31:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:18.715170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:18.753193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:18.838143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335999-aa12-4108-8c3f-5fa2c88ab0df None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:18.884096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:18.884773 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:18.885309 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:18.885791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:18.886762 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:18.887074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:18.888455 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:18.902002 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 204/427] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:18.907696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:19.031337 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433f8b-26da-4ab4-af7c-f219ae18b183 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:19.069974 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:19.070850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.071132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.071404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.118176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:19.147044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:19.148598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:19.255301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 224/428] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:19.260861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:19.375905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:19.385800 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feded1-afdc-4cf3-a030-2bffaec82ccf None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:19.424753 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089b03b-7e3f-413a-b2e9-18ffa184604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:19.425936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089b03b-7e3f-413a-b2e9-18ffa184604f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.426217 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089b03b-7e3f-413a-b2e9-18ffa184604f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.426488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089b03b-7e3f-413a-b2e9-18ffa184604f None admin] PATH_INFO: `/v3/projects/0a25fef9086f400895e3834cc2bc7398` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.427616 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089b03b-7e3f-413a-b2e9-18ffa184604f None admin] RBAC: Authorizing `identity:get_project(project_id=0a25fef9086f400895e3834cc2bc7398)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:19.429085 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089b03b-7e3f-413a-b2e9-18ffa184604f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:19.431067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 205/429] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:19 2022] GET /identity/v3/projects/0a25fef9086f400895e3834cc2bc7398 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:19.437044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:19.501621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:19.508408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859812fe-2281-4b7b-b8df-06cdb6c05933 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.508690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859812fe-2281-4b7b-b8df-06cdb6c05933 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.509005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859812fe-2281-4b7b-b8df-06cdb6c05933 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.510552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 206/430] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:19.515766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada489-df73-4cbc-ad1e-5a2dac39c62d None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.516308 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada489-df73-4cbc-ad1e-5a2dac39c62d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.516778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada489-df73-4cbc-ad1e-5a2dac39c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.542000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-daada489-df73-4cbc-ad1e-5a2dac39c62d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:19.543791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-daada489-df73-4cbc-ad1e-5a2dac39c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:19.551688 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2b061-52a7-4601-b384-56526db4ce52 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:19.600211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:19.600857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.601300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.601711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.602943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:19.604634 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:19.606715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 225/431] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:19 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:19.620822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:19.627878 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 207/432] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:19.654424 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc264bb-0997-4726-b30d-21690db5aba8 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.654840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc264bb-0997-4726-b30d-21690db5aba8 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.655031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc264bb-0997-4726-b30d-21690db5aba8 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.656502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 208/433] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:19.662039 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1d921-7d68-4402-a945-55d2273b258b None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.662565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1d921-7d68-4402-a945-55d2273b258b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.663034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1d921-7d68-4402-a945-55d2273b258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.682278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-5ce1d921-7d68-4402-a945-55d2273b258b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:19.683999 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-5ce1d921-7d68-4402-a945-55d2273b258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:19.733358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2cbe-219c-4967-8423-e8092a2903ab None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:19.754808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 209/434] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:19.754808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f69e-abba-494c-bdb6-ba44713c9ce4 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.754808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f69e-abba-494c-bdb6-ba44713c9ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.754808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f69e-abba-494c-bdb6-ba44713c9ce4 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.765524 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:19.766807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 210/435] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:19.772993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.773373 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.773750 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.774782 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:19.775425 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:19.775711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:19.775987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:19.776710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=0a25fef9086f400895e3834cc2bc7398) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:19.777054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:19.778526 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:19.785447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 226/436] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:19 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=0a25fef9086f400895e3834cc2bc7398&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:19.793291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:19.794542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:19.811591 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:19.874950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 211/437] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:19.989329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.088071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.111914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8405a-a084-4efc-9664-67b54a7e1f2f None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.160292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.161112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.161389 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.161667 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.174007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:20.180000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:20.180958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:20.181796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 227/438] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:20.188489 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.235570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee557-25da-472d-a4ac-19fdfdb682ac None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.249412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.282811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.283165 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.283357 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.283940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.294964 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:20.299837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:20.301476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 212/439] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:20.302328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.305533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68b4c-25b6-4ef1-9e9c-d117093a734e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.314261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.339941 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.340535 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.340836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.341112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.341763 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:20.342067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:20.343437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:20.352115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 228/440] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:20.352927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.403312 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9ab20-0f6b-4fec-b6d7-12875ba6d7d9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.436325 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.436966 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.437240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.437510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.448285 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:20.450060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33293198-4b4b-4278-a38a-f635bfaff4d7 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:20.453565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:20.454531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 213/441] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:20.455393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.469433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.486546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.487122 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.487396 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.487664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.488363 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:20.488659 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:20.490040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:20.497565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 229/442] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:20.502608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.520286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.554626 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc574114-46af-4955-891a-5f1c7e7e3ac5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.588581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.589205 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.589487 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.589759 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.599599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f6cb6-20ca-48ce-b757-1ee0e4d8c90a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.632696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.633320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.633597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.633868 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.634513 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:20.634812 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:20.636180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:20.643986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 230/443] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:20.645349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.660146 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:20.661847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:20.687587 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.725069 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.744403 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac310b-74d5-47c0-aaef-f8b687718ed6 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.759836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 214/444] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:20.760861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.777409 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.778023 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.778301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.778566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.844116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:20.845613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:20.857665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd35ad6-da9c-41e1-a392-e125108360d3 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:20.888287 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.890540 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:20.891136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:20.891416 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:20.891689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:20.925874 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:20.947070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 231/445] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:20.947906 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:20.959476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:20.960971 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.047251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e88776-ec6a-4b88-ae31-baa53f50cbd3 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.057973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 215/446] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:21.058808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.080678 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.081325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.082120 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.082387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.083482 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.084918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.086577 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 232/447] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:20 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.087241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.101984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:21.127832 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:21.161675 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b58de-72b8-41a8-b48a-f8e7a3714fda None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.191608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccf9e6-5597-44d3-9cb3-ad65085e37bd None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.197034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.197655 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.197937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.198210 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] PATH_INFO: `/v3/projects/2e8adffa42de46efb50aab220c9dfd70` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.199330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] RBAC: Authorizing `identity:get_project(project_id=2e8adffa42de46efb50aab220c9dfd70)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.200807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.202429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 216/448] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/projects/2e8adffa42de46efb50aab220c9dfd70 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.203188 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.225128 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.225744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.226021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.226292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] PATH_INFO: `/v3/projects/13b9411a439646919a95885e1ed2dcbc` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.227394 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] RBAC: Authorizing `identity:get_project(project_id=13b9411a439646919a95885e1ed2dcbc)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.228832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.230439 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 233/449] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/projects/13b9411a439646919a95885e1ed2dcbc => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.231180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.300623 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d5f6-8897-4e96-9e88-60ccf3a6242e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.306477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:21.328193 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc3e85-dcfb-4942-9284-0c549393df48 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.335466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.336082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.336370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.336643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.337808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.339241 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.340903 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 217/450] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.341710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.345110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:21.366408 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.367033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.367312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.367583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] PATH_INFO: `/v3/groups/69b6c25d413d4433900bf99829d162a8` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.368687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] RBAC: Authorizing `identity:get_group(group_id=69b6c25d413d4433900bf99829d162a8)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.370157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.371741 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 234/451] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/groups/69b6c25d413d4433900bf99829d162a8 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.372489 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.438339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d396320-f543-4ef4-b775-c9e8e0dbaebd None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.468450 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be17d23-e37b-46e8-91b6-47b321aa0a74 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.474440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.475057 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.475339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.475611 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] PATH_INFO: `/v3/groups/473cbbc9843040829d94102b1193ae4f` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.476718 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] RBAC: Authorizing `identity:get_group(group_id=473cbbc9843040829d94102b1193ae4f)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.478192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.479779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 218/452] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/groups/473cbbc9843040829d94102b1193ae4f => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.480550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.504695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.505321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.505596 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.505865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.506584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4, scope.project.id=2e8adffa42de46efb50aab220c9dfd70) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:21.506903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.508300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.513860 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 235/453] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.514627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:21.529009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:21.563429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:21.597573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f41018-6648-48fc-be28-e1d06586701c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.636288 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da8807-9091-4c1d-beb5-b876b75561b2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:21.638097 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.639605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.639897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.640239 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.640933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] RBAC: Adding query filter params (group.id=69b6c25d413d4433900bf99829d162a8, role.id=600c5bd8ce74469bb32ebbd74ce125cc, scope.project.id=2e8adffa42de46efb50aab220c9dfd70) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:21.641248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.642739 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a317-876e-4b6d-bce6-b78f4f3ebb1a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.656825 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 219/454] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/role_assignments?group.id=69b6c25d413d4433900bf99829d162a8&scope.project.id=2e8adffa42de46efb50aab220c9dfd70&role.id=600c5bd8ce74469bb32ebbd74ce125cc => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:21.676341 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:21.676992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:21.677269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:21.677536 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:21.678264 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] RBAC: Adding query filter params (group.id=473cbbc9843040829d94102b1193ae4f, role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=13b9411a439646919a95885e1ed2dcbc) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:21.678568 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:21.680062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724661f-c8f1-4e2b-8a55-1aae48cfefd1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:21.687157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 236/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 10 20:31:21 2022] GET /identity/v3/role_assignments?group.id=473cbbc9843040829d94102b1193ae4f&scope.project.id=13b9411a439646919a95885e1ed2dcbc&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:24.627320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36294f8-6a8f-4caf-be76-a189fe6ba1bf None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:24.628271 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36294f8-6a8f-4caf-be76-a189fe6ba1bf None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:24.628682 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36294f8-6a8f-4caf-be76-a189fe6ba1bf None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:24.630434 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 220/456] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:24.636123 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df277-ebff-4dbd-b4de-7f1026016ce6 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:24.637004 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df277-ebff-4dbd-b4de-7f1026016ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:24.637492 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df277-ebff-4dbd-b4de-7f1026016ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:24.657597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-441df277-ebff-4dbd-b4de-7f1026016ce6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:24.659083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-441df277-ebff-4dbd-b4de-7f1026016ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:24.732228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 237/457] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:24.733899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c381df-f54b-40f9-a89c-1fc35f4871d6 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:24.734184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c381df-f54b-40f9-a89c-1fc35f4871d6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:24.734716 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c381df-f54b-40f9-a89c-1fc35f4871d6 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:24.736478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 221/458] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:24.742527 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777f0cd-c15e-4d43-9d41-eb5c2fc8ebac None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:24.743079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777f0cd-c15e-4d43-9d41-eb5c2fc8ebac None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:24.743566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777f0cd-c15e-4d43-9d41-eb5c2fc8ebac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:24.761212 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:24.764039 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-d777f0cd-c15e-4d43-9d41-eb5c2fc8ebac None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:24.765736 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-d777f0cd-c15e-4d43-9d41-eb5c2fc8ebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:24.837852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 238/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:24.903231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5eb2f-05b4-4d31-bd09-126f0d7f28dc None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:24.903412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5eb2f-05b4-4d31-bd09-126f0d7f28dc None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:24.903690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5eb2f-05b4-4d31-bd09-126f0d7f28dc None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:24.905331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 222/460] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:24.910652 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:24.910947 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:24.911216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:24.929771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:24.931021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:25.005083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 239/461] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:25.101814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5eb2f-05b4-4d31-bd09-126f0d7f28dc None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.179445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.216977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5eb2f-05b4-4d31-bd09-126f0d7f28dc None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.244955 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:25.254602 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.255932 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.256220 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.256497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.259194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:25.271059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.272518 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.285223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f3c3-625f-4831-ae2e-c82ecf250554 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-70b1226d-ddfc-4a43-8701-a9d8ebce070e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:25.288305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:25.289223 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:25.290155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:25.290155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:25.290155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:25.294351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 223/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:25.295495 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0373d-3c00-4da9-9608-5c4eb9fa83bc None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.295790 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0373d-3c00-4da9-9608-5c4eb9fa83bc None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.296067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0373d-3c00-4da9-9608-5c4eb9fa83bc None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.301068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 224/463] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:25.301068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0373d-3c00-4da9-9608-5c4eb9fa83bc None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.325580 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.326301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.326474 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.326748 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.337148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.338596 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-36161788-1342-4937-b258-f3b1bdfee3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:25.352746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:25.353834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:25.354693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:25.354693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:25.354693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:25.354693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 240/464] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:25.355359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.355640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.355909 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.373393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:25.374566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:25.404451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0373d-3c00-4da9-9608-5c4eb9fa83bc None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.437515 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.438043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.438327 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.438608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.439348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:25.439655 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.440332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 241/465] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:25.441689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.441791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.459481 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 225/466] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:25.460309 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.499995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:25.511834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:25.556444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920831b-27ca-420d-b848-658f0adcbd04 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.569084 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dfe9e-9a5a-43a7-8a3f-f6e89052529b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.591807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.592424 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.592703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.593005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.603553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.604968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.605089 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.605563 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.605842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.606110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.606736 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:25.607037 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.608385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.623737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 226/467] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:25.623737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:25.623956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:25.624981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:25.625811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:25.625811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:25.625811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:25.625811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 242/468] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:25.626038 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.731667 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:25.735719 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbe796-ddc2-4ae0-b6fa-90aea461a4da None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.739079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3cf2b-1f55-4ef1-a995-a1d964c21b35 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.745386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:25.773065 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.773662 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.773948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.774221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.774937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.775855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:25.776373 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.776473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:25.776719 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:25.777021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:25.777659 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:25.779068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:25.798315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 227/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:31:25 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:31:25.799131 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.804849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 243/470] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:31:25 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:31:25.804849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:25.941117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cc25-1c82-49a3-b8f5-f97342b5eea1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:25.966489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d13a51-1358-41a8-b262-6fc86a419733 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:26.001001 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:26.002457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:26.002858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:26.003755 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:26.017727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:26.020067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:26.021741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:26.022939 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:26.024016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:26.024483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:26.025347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:26.025818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:26.027478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:26.042140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:26.043092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:26.043920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:26.043920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:26.043920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:26.043920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 244/471] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:26.048244 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 228/472] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:26.050042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:26.051950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:26.062112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:26.086048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:26.176380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0c971-6f0a-4bb1-b589-63af13e2c937 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:26.183290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89504ce-7963-4ed2-b1c4-06e81e1ac456 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:26.214694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:26.215296 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:26.215607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:26.215883 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:26.216523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:26.218070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:26.223813 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:26.224501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:26.224873 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:26.225214 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:26.225912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:26.226277 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:26.228903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8314327-6971-4c6f-bd53-804bebc47858 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:26.243970 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 229/473] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:31:26 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:31:26.245686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 245/474] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:26.253288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:26.354121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:26.377002 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d3e8c-dcdf-4cdc-a3c3-99c19634be64 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:26.414841 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed030-5081-48b6-92ca-e4ba97d16f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:26.415487 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed030-5081-48b6-92ca-e4ba97d16f42 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:26.415769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed030-5081-48b6-92ca-e4ba97d16f42 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:26.416051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed030-5081-48b6-92ca-e4ba97d16f42 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:26.416732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed030-5081-48b6-92ca-e4ba97d16f42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:26.418275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed030-5081-48b6-92ca-e4ba97d16f42 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:26.442207 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 230/475] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:31:26 2022] POST /identity/v3/users => generated 249 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:31:28.385133 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971227ed-b5b7-460f-8e7f-bf82bf334fa6 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:28.385682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971227ed-b5b7-460f-8e7f-bf82bf334fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:28.385682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971227ed-b5b7-460f-8e7f-bf82bf334fa6 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:28.387013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 246/476] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:28.392841 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb55fd8-3f82-4cfb-b474-1588fe6cb731 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:28.394166 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb55fd8-3f82-4cfb-b474-1588fe6cb731 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:28.394609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb55fd8-3f82-4cfb-b474-1588fe6cb731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:28.412967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-3cb55fd8-3f82-4cfb-b474-1588fe6cb731 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:28.414388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-3cb55fd8-3f82-4cfb-b474-1588fe6cb731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:28.431517 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f50bf-6103-4e2b-a1c0-b9fa8c206534 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:28.431795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f50bf-6103-4e2b-a1c0-b9fa8c206534 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:28.432068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f50bf-6103-4e2b-a1c0-b9fa8c206534 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:28.434257 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 247/477] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:28.440646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e65d-47e0-4874-b591-f36dc2a0f7ac None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:28.440964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e65d-47e0-4874-b591-f36dc2a0f7ac None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:28.441237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64e65d-47e0-4874-b591-f36dc2a0f7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:28.463027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-9c64e65d-47e0-4874-b591-f36dc2a0f7ac None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:28.464219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-9c64e65d-47e0-4874-b591-f36dc2a0f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:28.505008 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 231/478] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:28.542428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:28.552119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 248/479] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:28.727080 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de19e5-cee3-486d-a8d2-13723998ad66 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:28.727740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de19e5-cee3-486d-a8d2-13723998ad66 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:28.728216 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de19e5-cee3-486d-a8d2-13723998ad66 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:28.729994 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 232/480] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:28.738111 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:28.738618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:28.739099 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:28.757970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:28.759399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:28.830890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 249/481] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:28.854665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de19e5-cee3-486d-a8d2-13723998ad66 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:28.884646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:28.937114 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:28.989150 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de19e5-cee3-486d-a8d2-13723998ad66 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:28.994708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65174c5-c251-4c89-be35-4096970b16e1 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.025133 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.033527 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008dfa0-d410-47ac-967a-512b3bbf0cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.034790 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008dfa0-d410-47ac-967a-512b3bbf0cdc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.035066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008dfa0-d410-47ac-967a-512b3bbf0cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.035498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008dfa0-d410-47ac-967a-512b3bbf0cdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.038415 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be6a5b-1098-442a-a6d7-ff907dff711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.039051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6a5b-1098-442a-a6d7-ff907dff711b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.039335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6a5b-1098-442a-a6d7-ff907dff711b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.039610 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6a5b-1098-442a-a6d7-ff907dff711b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.046291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008dfa0-d410-47ac-967a-512b3bbf0cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:29.051007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be6a5b-1098-442a-a6d7-ff907dff711b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-7008dfa0-d410-47ac-967a-512b3bbf0cdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:29.051597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.052459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 233/482] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:29.057725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c0a36-c325-4f6f-93f5-ade9eee45b4d None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.058415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c0a36-c325-4f6f-93f5-ade9eee45b4d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.058415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c0a36-c325-4f6f-93f5-ade9eee45b4d None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-95be6a5b-1098-442a-a6d7-ff907dff711b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:29.058546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.059320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.060097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:29.060754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 234/483] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:29.066442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 250/484] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:31:29.066442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.066442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.066442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.066756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c0a36-c325-4f6f-93f5-ade9eee45b4d None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.082598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:29.083800 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:29.150895 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 251/485] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:29.151739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.192006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c0a36-c325-4f6f-93f5-ade9eee45b4d None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.220693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.231138 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.231833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.232121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.232390 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.233087 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:29.233413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.234821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.246339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 235/486] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:29.247340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.284557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc27bfd-80eb-45e2-b43c-84db862b2069 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.302030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.321936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.322875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.323222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.323563 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.324326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:29.324721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.326182 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.339279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 252/487] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:29.339279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.357306 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7e5a-88d3-40ef-8501-61151ee6ea5c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.397794 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.398520 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.398769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.398968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.411700 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:29.417587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.418550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 236/488] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:29.419473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.457822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cfac8-603e-4462-b971-fad92e6fe5e7 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.476139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.491896 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.492484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.492770 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.493139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.504450 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.505920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:29.520253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.521438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:29.522484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:29.522484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:29.522484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:29.522484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 253/489] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:29.522484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.531347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bba8d-78cb-46d0-be04-7c255b2591bf None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.552405 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.563998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.564615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.564914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.565709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.576212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.577776 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:29.592380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.593446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:29.599232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:29.599232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:29.599232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:29.599232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 237/490] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:29.599232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.621349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df2460-24c1-479d-be6a-0626adc189de None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.653908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.654498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.654774 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.655044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.655686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:29.656087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.657488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.665043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 254/491] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:29.665817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.696076 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.698969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ad2e6-be28-4c08-ac7d-e6da1d4be9e4 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.732732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.733383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.733664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.733934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.743693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:29.748823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.749684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:29.750467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 238/492] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:29.751102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.760355 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.769674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0a1a4-e809-4d81-99ce-9b71feee5c13 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.801405 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.802003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.802276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.802544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.803160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:29.803455 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.804852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.816528 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 255/493] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:29.817331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.856470 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8c412-ede7-4e1f-9923-aaccac40735a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.890062 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.890643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.890922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.891193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.891819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:29.892117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.894018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.905238 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 239/494] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:29.906034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.914040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84692025-a4d1-42e4-94f6-a0271d1ad935 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:29.927033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:29.947821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:29.948437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:29.948718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:29.949019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:29.959587 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:29.961083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:29.975945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:29.976900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:29.977752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:29.977752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:29.977752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:29.977752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 256/495] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:29.977977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:29.986021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.007324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b05b41-d57f-45c2-b513-b88d5027be75 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.042737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.043331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.043605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.043874 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.044521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:30.044841 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.046222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.054408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 240/496] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:30.055189 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.086432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b442f-1b11-4c86-a9ef-e72398f9f6f4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.119273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.119896 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.120176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.120448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.127674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.129185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.134361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:30.142066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:30.143017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 257/497] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 10 20:31:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:30.144494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.155568 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30a8d8-d8fa-431f-a0da-2dc18f950d58 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.188150 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.188766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.189071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.189342 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.197450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.198901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.204749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:30.211660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:30.212733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 241/498] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:30.213911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.246044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d937da-b934-40e0-a35a-2fd51a339464 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.278936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.279453 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.279730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.279999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.280619 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:30.280942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.282309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.294251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 258/499] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:30.295025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.312917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb0f8-cebe-4eb8-8b14-3cc44d4b6ce8 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.346116 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.346756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.347034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.347302 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.357609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.359064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.360723 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:30.373430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:30.374502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:30.375457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:30.375457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:30.375457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:30.375457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 242/500] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:30.375457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.400276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab52f-c06d-4a0d-bd8f-69fab39acb8b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.422581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.434414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.435025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.435325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.435619 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.436329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:30.436630 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.438095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.473625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb068e7-c87e-4b7c-b7f9-67e4026c30d7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.475133 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 259/501] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:30.475944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.513384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.513984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.514266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.514541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.515251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:30.515823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.517023 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.553054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 243/502] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:30.553809 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.576475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da19f-f7be-41c3-a86d-af2000f1b99d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.604321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.609849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.610471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.610755 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.611030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.619045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.620495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:30.633897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:30.634925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 260/503] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:30.636283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.654838 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5a8c-d8f3-47e5-918c-a456d5cfe677 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.678054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.688119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.688717 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.689028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.689298 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.689920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:30.690282 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.691649 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.706944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 244/504] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:30.707669 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:30.743345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acd5f3-86b3-4591-8ede-ede4515ea5f3 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.776432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.777052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.777329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.777596 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.806741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f3ce5-2214-468b-8df3-cebe48cabbd3 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:30.819008 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.841198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:30.841792 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:30.842070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:30.842341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:30.843013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.844465 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.884410 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:30.908633 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:30.910218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:30.941139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 261/505] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:30.941955 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.015639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 245/506] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:31.016911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.031464 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.041972 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8a43-390a-4bbc-90df-7bf5226b05d3 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.075057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.075647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.075925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.076199 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.076941 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:31.077241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.078659 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.091978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.096330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 262/507] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 10 20:31:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:31.097881 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.116285 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aba03-0ae2-451a-ab47-02f92a5397d4 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.148973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.149586 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.149868 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.150144 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.156951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.158386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:31.170172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:31.171053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 246/508] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:31.176778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.194506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305552a7-611a-4ca7-a4a7-92a27809b49d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.228119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.228736 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.229046 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.229328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.239029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.240471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.242577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:31.256426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:31.257404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:31.258253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:31.258253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:31.258253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:31.258253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 263/509] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:31.258468 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.278482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630e858-90a9-4284-97fc-9278e521b85a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.310219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.312228 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.312910 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.313199 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.313471 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.324641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.326197 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:31.339945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:31.340917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:31.342360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:31.342360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:31.342360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:31.342360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 247/510] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:31.342360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.362478 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd00bd-2438-44ca-96b3-2310fb6f1862 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.396023 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.396618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.396934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.397209 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.438703 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba5a3-3987-414c-8d31-9a3cd278dc20 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.461349 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.462424 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.464442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.472120 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.472710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.473011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.473279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.473984 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:31.474523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.475681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.493574 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 248/511] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:31.494403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.515959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.564677 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 264/512] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:31.565571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.590945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689e2a-1fff-4685-bfea-4e2a0d5eff01 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.623937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.624537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.624842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.625119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.625752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:31.626053 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.627417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.639152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 249/513] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:31.639967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.666639 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee19ad8-dc5c-4cb5-8b24-909b11a06d62 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.682355 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.700453 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.701075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.701356 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.701627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.702255 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:31.702551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.703919 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.715449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 265/514] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:31.716242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.733655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.745263 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918c0c-fdfc-4c37-bc14-a96316120f8c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.780686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.781318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.781598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.781875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.819964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b8466-7471-4dad-af18-88214dbc92ce None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:31.848384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.849828 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.852394 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:31.853056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:31.853331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:31.853601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:31.864403 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:31.865947 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:31.879690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:31.880601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:31.881738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:31.881738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:31.881738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:31.881738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 266/515] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:31.881738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.894852 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.943182 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:31.950807 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 250/516] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:31.951637 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:31.982371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a05a7e-632a-4e0a-b17f-85ed07f246ee None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.017185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.017817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.018090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.018385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.025220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.026748 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:32.042953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:32.043858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:32.044690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 267/517] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:32.045204 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.059852 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d6d7-5538-4145-9634-6fd5d022617c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.093326 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.093940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.094211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.094478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.101505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.102892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:32.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:32.115071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:32.115906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 251/518] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:32.116383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.122228 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.150174 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc367-5d6b-48de-b6ab-bf63ec2048a2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.172447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.184092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.184685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.185002 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.185273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.185895 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.186190 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.187608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.199426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 268/519] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.200532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.219663 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783129c9-0e10-49c1-a457-16641375b2f5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.253879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.254500 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.254785 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.255497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.266172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.267621 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:32.281143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:32.282051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:32.282918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:32.282918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:32.282918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:32.282918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 252/520] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:32.283289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.305185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e332-8ffa-4851-a02e-e0a3a6ccb772 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.343086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.343686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.343981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.344248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.344916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.345021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.348025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.348025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.365505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 269/521] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.366070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.392047 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666a51e-2892-40bd-ad86-38d9ff6e0800 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.410966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.426074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.426664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.426937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.427212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.427880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.428178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.429628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.447342 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 253/522] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.448133 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.470338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063c57-f6f1-459a-83f6-89b5adb17576 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.503180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173acf-7480-4924-8e58-76485e698312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.503794 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173acf-7480-4924-8e58-76485e698312 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.504066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173acf-7480-4924-8e58-76485e698312 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.504329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173acf-7480-4924-8e58-76485e698312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.510966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173acf-7480-4924-8e58-76485e698312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.512427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173acf-7480-4924-8e58-76485e698312 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-de173acf-7480-4924-8e58-76485e698312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:32.523960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:32.525428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 270/523] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:32.526479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173acf-7480-4924-8e58-76485e698312 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.549724 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c57d6-bcdd-4786-a148-07073858a07c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.563143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.584031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.584622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.584936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.585207 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.585828 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.586126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.587493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.598908 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 254/524] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.599505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.626740 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173acf-7480-4924-8e58-76485e698312 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.629407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.661008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.661597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.661874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.662143 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.662842 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.663154 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.664583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.669855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 271/525] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/role_assignments?user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.670641 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.722374 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086bf89-5e98-4043-8bbb-836910b506dc None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.765846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.766709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.767146 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.767419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.768186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=a2edea27275f4d75831629f1de22d43d) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.768495 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.770030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.784301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 255/526] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/role_assignments?user.id=a2edea27275f4d75831629f1de22d43d&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.784301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.813291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf26a-f3ac-4f0e-8e1c-b7ef4c22dfed None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.842428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.857249 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.857874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.858154 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.858426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.859150 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:32.859456 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.861654 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:32.881349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 272/527] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:32.884382 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:32.927886 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b2e37-eb74-4548-8ea9-977d7af36eaf None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:32.928607 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:32.968875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:32.969603 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:32.969886 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:32.970156 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:32.986481 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:32.988571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:33.015668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:33.016607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:33.017931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 256/528] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:33.023567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:33.031931 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173862-761d-4d9e-8bfd-4cfa410599c8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:33.072882 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:33.074562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:33.075020 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:33.075491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:33.076380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=6fbd946e624a40a5ba757daa22cec6f4) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:33.076923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:33.078536 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:33.086298 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 273/529] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:32 2022] GET /identity/v3/role_assignments?user.id=6fbd946e624a40a5ba757daa22cec6f4&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:33.154499 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb35cb-c2ad-4539-8a2e-16da7b10110e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:33.156359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:33.195390 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:33.195998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:33.196269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:33.196533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:33.197265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:33.197568 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:33.199195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019d73-e7e5-456a-be4d-eee28d32fcb8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:33.213270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 257/530] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:33.218889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:33.321078 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:33.331098 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4064-8919-4016-ab9b-76a831b6ffc4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:33.367772 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:33.368461 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:33.368831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:33.369173 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:33.369953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=1ae5691b5c9e45be9a585d5db0ab5cc9) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:33.370325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:33.371809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fccb0e-6427-4e74-bcbf-4121c0754860 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:33.378335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 274/531] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:33 2022] GET /identity/v3/role_assignments?user.id=1ae5691b5c9e45be9a585d5db0ab5cc9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:35.191006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a12ec-3040-4ae2-b658-72ff56dbd2f9 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.191516 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a12ec-3040-4ae2-b658-72ff56dbd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.191591 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a12ec-3040-4ae2-b658-72ff56dbd2f9 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.193173 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 258/532] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:35.198843 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b111d0-dccb-4cae-bed7-f1e6757a706b None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.199706 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b111d0-dccb-4cae-bed7-f1e6757a706b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.200183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b111d0-dccb-4cae-bed7-f1e6757a706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.219687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-60b111d0-dccb-4cae-bed7-f1e6757a706b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:35.221893 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-60b111d0-dccb-4cae-bed7-f1e6757a706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:35.297063 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 275/533] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:35.345953 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3e3f-6e40-43d8-ab8f-b4126836ae6a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.346893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3e3f-6e40-43d8-ab8f-b4126836ae6a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.347081 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3e3f-6e40-43d8-ab8f-b4126836ae6a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.348770 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 259/534] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:35.354043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1972-cffe-41f5-8a56-7fa87e8a9966 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.354333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1972-cffe-41f5-8a56-7fa87e8a9966 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.354614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1972-cffe-41f5-8a56-7fa87e8a9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.373775 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-855e1972-cffe-41f5-8a56-7fa87e8a9966 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:35.375767 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-855e1972-cffe-41f5-8a56-7fa87e8a9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:35.450636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 276/535] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:35.543084 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0118-63e4-4548-86fc-deefd2ab9e7b None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.543425 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0118-63e4-4548-86fc-deefd2ab9e7b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.543641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0118-63e4-4548-86fc-deefd2ab9e7b None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.545409 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 260/536] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:35.551200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.551814 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.552280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.575390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:35.576596 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:35.587717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:35.646229 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0118-63e4-4548-86fc-deefd2ab9e7b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:35.647647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 277/537] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:35.751329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0118-63e4-4548-86fc-deefd2ab9e7b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:35.787203 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:35.787826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.788100 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.788368 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.798544 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:35.803955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:35.804847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:35.805647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 261/538] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:35.811636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:35.837834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:35.858421 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:35.921678 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910c2e7-181e-446f-aa62-14d8443d57cc None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:35.941335 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1a41-fd47-4b47-b99f-32537a0f0567 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:35.958937 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:35.959545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.959853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.960094 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.960749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:35.961081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:35.962470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cccb91-0031-411d-a731-6b9d82e57dea None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:35.974952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 278/539] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:35.974952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae576-752c-4d10-b9dd-45d8d03cb8b4 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.974952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae576-752c-4d10-b9dd-45d8d03cb8b4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.974952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae576-752c-4d10-b9dd-45d8d03cb8b4 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.974952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 279/540] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:35.978282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae576-752c-4d10-b9dd-45d8d03cb8b4 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:35.979656 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78807d-320d-4e35-b817-e41c5bafbce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:35.980272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78807d-320d-4e35-b817-e41c5bafbce3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:35.980600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78807d-320d-4e35-b817-e41c5bafbce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:35.980903 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78807d-320d-4e35-b817-e41c5bafbce3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:35.992461 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:35.995995 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78807d-320d-4e35-b817-e41c5bafbce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-8b78807d-320d-4e35-b817-e41c5bafbce3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:36.001334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.002956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 262/541] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:31:36.005685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.006411 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.006411 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.022227 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:36.023422 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:36.090472 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae576-752c-4d10-b9dd-45d8d03cb8b4 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.105500 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 263/542] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:36.106339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.125842 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.126605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.126822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.127112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.127949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.140027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.141515 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:36.156828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.157820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:36.158651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:36.158651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:36.158651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:36.158651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 280/543] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:36.159721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.225722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91224-65d5-4900-8d06-32cec6002d63 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.227843 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.266204 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.266825 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.267102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.267388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.271221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1b825-b84b-4659-ae8b-426f1db3035e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.277324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:36.282013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.282933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 264/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:36.285050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.312718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.313353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.313622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.313894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.314538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:36.315379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.316777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.326923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 281/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:36.326923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.357989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.393894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2ecb0-60bd-46fe-86b2-f0bf576edece None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.431347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.431953 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.432232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.432503 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.433171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:36.433471 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.434840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.440377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a111d9e-8cab-4756-ae14-835bd069f8af None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.446678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 265/546] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:36.447483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.463299 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.475692 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.476289 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.476562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.476860 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.477503 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:36.477801 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.479155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.487292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 282/547] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:36.488064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.545548 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752141e9-8a27-4355-bb43-1eeb6b89e5ec None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.571131 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.579347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.579961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.580243 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.581045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.585000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bcec5-243e-4af1-bfa0-ee60430984e3 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.591331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.592768 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:36.607082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.608178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:36.609102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:36.609102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:36.609102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:36.609102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 266/548] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:36.609102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.622079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.622696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.622970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.623237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.633413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:36.639292 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.640157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:36.640973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 283/549] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:36.641662 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.686228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.706899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e4b19-93b8-43cd-b5e4-4beca8e379a7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.738992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75547dc-71dc-465b-b9a4-3df03d1f2d96 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.739473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.740092 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.740372 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.740671 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.747804 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.749294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:36.760382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.761275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:36.762170 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 267/550] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:36.763253 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.777460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.778076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.778349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.778618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.788965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.790403 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.802689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:36.804648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:36.805571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:36.806412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:36.806412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:36.806412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:36.806412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 284/551] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:36.806644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.862666 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4f02-70ea-41b6-bf96-51ce079c3ebb None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.894372 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.894958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.895231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.895499 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.896115 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:36.896412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.897811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.899334 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:36.906450 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93f4aa-a189-4d5b-8361-4f713bd8f863 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:36.909417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 268/552] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:36.909950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:36.943001 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:36.943597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:36.943879 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:36.944157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:36.945119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:36.945422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:36.946784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:36.954731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 285/553] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:36.955548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.012256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.015672 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c8b95-2c0b-4c84-aa21-0106e028b6e1 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.052726 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.053353 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.053636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.053911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.054621 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:37.054928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.055554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d582a9-e9ae-4030-9f17-a089f4728d34 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.056357 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.074123 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 269/554] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:37.074938 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.091178 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.091922 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.092280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.092622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.093367 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:37.093737 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.095153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.106465 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 286/555] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:37.107302 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.124682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.176509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba151-41a8-4d0f-b8c6-90bf870b121d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.204634 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485d4c0-bba5-4468-9f28-014f22d528d9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.210542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.211161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.211821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.212106 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.219629 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.221636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:37.233009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:37.241690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 270/556] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:37.243508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.245029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.245029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.245029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.245029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.251123 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.252880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.254338 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:37.268031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:37.269132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:37.270073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:37.270073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:37.270073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:37.270073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 287/557] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:37.270073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.338899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.339814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15261e5-ebdd-4012-81e2-303880610a4a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.370722 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326241-86d3-4976-a509-ba5695f3ab7a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.372970 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.373593 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.373870 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.374141 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.384297 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.385720 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:37.399846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:37.401340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:37.402208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:37.402208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:37.402208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:37.402208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 271/558] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:37.402208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.406965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.407642 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.407922 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.408190 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.415836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.417900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:37.429441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:37.430557 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 288/559] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:37.432081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.474974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.507247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41bda-0433-4e20-9229-5878431acb2b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.530494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0f8f9-3862-448b-9224-530cf4cbed10 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.541394 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.542153 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.542431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.542703 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.543413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:37.543715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.545159 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.558066 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.562249 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 272/560] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:37.563048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.564832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.565439 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.565721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.565991 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.566752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:37.566913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.568279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.580013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 289/561] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:37.581385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.661362 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54d36d-0528-460b-a013-bf71ff5f21a8 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.676737 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b88ba8-a950-4170-995b-4070cbeab04d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.687072 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.695769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.696363 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.696644 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.696946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.697645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:37.697952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.699343 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.708905 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.709488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.709762 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.710041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.710154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 273/562] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:37.710727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:37.710937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.711033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.712423 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.730263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 290/563] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:37.731051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.780546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.818424 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27461f-e354-46db-abda-0d78e4ecb604 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.834113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8031-9aaf-4b14-bd6c-ea3d2cfee91e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.850883 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.851523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.851800 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.852069 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.862194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.863620 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.866610 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:37.867222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:37.867498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:37.867823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:37.874684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:37.876098 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:37.878111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:37.879043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:37.880061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:37.880061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:37.880061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:37.880061 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 274/564] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:37.880403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:37.889544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:37.890656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 291/565] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:37.891695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:37.923057 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:37.979215 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579e250-ecad-4190-b00d-73d6a2c1b0d5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:37.990751 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5445d-bf84-46dd-9e1e-effef005dda1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.000320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.012346 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.012994 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.013270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.013537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.019927 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.021399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.025585 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.026198 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.026478 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.026752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:38.032191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:38.033126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:38.034578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 275/566] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:38.035066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.039991 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.041486 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:38.055986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:38.057048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:38.057952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:38.057952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:38.057952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:38.057952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 292/567] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:38.057952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.132548 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.135747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4618-8998-4d94-a790-aacc30eee852 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.154713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87df3c8-d6c9-43b5-b86d-f5555d34c839 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.168454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.169082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.169360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.169629 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.170255 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:38.170550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.171925 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.184335 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 276/568] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:38.185039 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.187165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.187759 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.188040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.188312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.189055 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:38.189357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.190898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.208395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 293/569] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:38.209233 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.229025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.288631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb087eb-3b59-4cd9-a51d-4d32dda959b6 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.310531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b6062-5248-40df-9c92-381a77433136 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.322179 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.322773 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.323051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.323319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.323990 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:38.324293 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.325746 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.337855 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 277/570] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:38.338625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.350749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.351463 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.351738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.352007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.352634 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:38.353076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.354437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.364163 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.365927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 294/571] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:38.366746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.448260 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd36fd-47ea-4222-b705-d8dd1e77fbc5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.448818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.469779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaef2a-5109-4b4a-a820-fe3c26fbe025 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.481824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.482454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.482734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.483007 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.490159 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.491599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:38.502789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:38.503824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:38.504741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:38.505226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.505226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.505226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.505226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.505474 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 278/572] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:38.505474 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.518428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.519876 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:38.533890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:38.534966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:38.535847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:38.535847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:38.535847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:38.535847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 295/573] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:38.536127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.590863 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.610544 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0aec8-22ee-4a5b-8055-17de28ee45c7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.633866 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac280c4-3a19-452f-a1b0-50dcd1fbaa1d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.643929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.644570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.644882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.645156 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/b4ff9eb972fa48f8ad0c32fa56f11fe9/roles/41ac2fa59279401c8f73e54f82a77b7d` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.659724 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=b4ff9eb972fa48f8ad0c32fa56f11fe9, role_id=41ac2fa59279401c8f73e54f82a77b7d)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.660647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.661204 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.667247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db476c8d-3933-4877-8691-0565491022cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.668051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db476c8d-3933-4877-8691-0565491022cd None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.668391 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db476c8d-3933-4877-8691-0565491022cd None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.668636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db476c8d-3933-4877-8691-0565491022cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.673423 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 279/574] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:31:38 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/b4ff9eb972fa48f8ad0c32fa56f11fe9/roles/41ac2fa59279401c8f73e54f82a77b7d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:38.688950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.689129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db476c8d-3933-4877-8691-0565491022cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.689129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db476c8d-3933-4877-8691-0565491022cd None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-db476c8d-3933-4877-8691-0565491022cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:38.692052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:38.693037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:38.693924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 296/575] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:38.694414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db476c8d-3933-4877-8691-0565491022cd None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.805817 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975ea65-3b60-4a6a-a566-c0d2ca630ab1 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.811918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db476c8d-3933-4877-8691-0565491022cd None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.842091 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.849224 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.849829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.850526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.850805 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.851613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:38.852039 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:38.852339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.852633 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:38.852947 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:38.853221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:38.853853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:38.854151 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:38.854559 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.855513 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:38.869258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 280/576] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:38.870545 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.874370 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 297/577] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:38.875353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:38.932508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:38.990233 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46339a2f-ad32-4dd4-9d55-47b02dfe6c30 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:38.992441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369120f6-6a33-41ba-953e-c4c250fa2211 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:39.032062 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:39.032752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:39.033059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:39.033421 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:39.034103 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:39.034405 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:39.034695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:39.035328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:39.035657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:39.035911 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:39.036035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:39.042973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:39.044403 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:39.056015 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 281/578] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:39.056015 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:39.059345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:39.060202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:39.061613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:39.062043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 298/579] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:39.068262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:39.113726 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:39.165647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf5f8-f67d-421f-99ef-2bcf7889af1e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:39.179035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50e4d-e712-4e85-916c-ec2ba2b4e3dd None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:39.190695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:39.211904 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:39.212554 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:39.212864 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:39.213142 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/a2edea27275f4d75831629f1de22d43d/roles/41ac2fa59279401c8f73e54f82a77b7d` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:39.217832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:39.218648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:39.219080 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:39.219506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/6fbd946e624a40a5ba757daa22cec6f4/roles/41ac2fa59279401c8f73e54f82a77b7d` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:39.228081 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=a2edea27275f4d75831629f1de22d43d, role_id=41ac2fa59279401c8f73e54f82a77b7d)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:39.229547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:39.235916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=6fbd946e624a40a5ba757daa22cec6f4, role_id=41ac2fa59279401c8f73e54f82a77b7d)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:39.238050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:39.243819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 282/580] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:31:39 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/a2edea27275f4d75831629f1de22d43d/roles/41ac2fa59279401c8f73e54f82a77b7d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:39.253094 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 299/581] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:31:39 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/6fbd946e624a40a5ba757daa22cec6f4/roles/41ac2fa59279401c8f73e54f82a77b7d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:39.254125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:39.379928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:39.383789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93790e-f1d6-4978-b26c-7a69f38f8b86 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:39.427193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:39.427973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:39.428326 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:39.428666 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:39.429456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:39.429834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:39.431382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce84b-2121-459a-9d2a-b79622556ebe None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:39.446855 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 283/582] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:39.453011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:39.562751 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750d68e-6274-459b-b967-76082aa9c9d8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:39.597346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c82d9-d8ce-429e-b7dc-38178a262021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:39.597988 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c82d9-d8ce-429e-b7dc-38178a262021 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:39.598265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c82d9-d8ce-429e-b7dc-38178a262021 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:39.598530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c82d9-d8ce-429e-b7dc-38178a262021 None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/1ae5691b5c9e45be9a585d5db0ab5cc9/roles/41ac2fa59279401c8f73e54f82a77b7d` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:39.616369 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c82d9-d8ce-429e-b7dc-38178a262021 None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=1ae5691b5c9e45be9a585d5db0ab5cc9, role_id=41ac2fa59279401c8f73e54f82a77b7d)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:39.617846 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c82d9-d8ce-429e-b7dc-38178a262021 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:39.636398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 300/583] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:31:39 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/1ae5691b5c9e45be9a585d5db0ab5cc9/roles/41ac2fa59279401c8f73e54f82a77b7d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:41.189632 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784a85e-3b6c-46a8-b33a-32816490558f None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.190512 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784a85e-3b6c-46a8-b33a-32816490558f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.190937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784a85e-3b6c-46a8-b33a-32816490558f None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.192667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 284/584] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:41.198527 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6abc-3987-4bb1-b40b-68a546fa813e None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.199281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6abc-3987-4bb1-b40b-68a546fa813e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.199719 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec6abc-3987-4bb1-b40b-68a546fa813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.218488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f7ec6abc-3987-4bb1-b40b-68a546fa813e None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:41.219903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f7ec6abc-3987-4bb1-b40b-68a546fa813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:41.222994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:41.290335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 301/585] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:41.630867 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784a85e-3b6c-46a8-b33a-32816490558f None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:41.748109 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784a85e-3b6c-46a8-b33a-32816490558f None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:41.782834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a626-060d-4712-ae49-dc762c98fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:41.785355 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a626-060d-4712-ae49-dc762c98fb66 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.785700 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a626-060d-4712-ae49-dc762c98fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.786032 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a626-060d-4712-ae49-dc762c98fb66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.787007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476cfa-3138-48d7-85a6-dca153a42ae3 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.787358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476cfa-3138-48d7-85a6-dca153a42ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.787707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476cfa-3138-48d7-85a6-dca153a42ae3 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.789252 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 302/586] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:41.794676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b0e4d-6fa4-459f-9557-20e24b34c933 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.795022 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b0e4d-6fa4-459f-9557-20e24b34c933 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.795384 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b0e4d-6fa4-459f-9557-20e24b34c933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.798276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a626-060d-4712-ae49-dc762c98fb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-c189a626-060d-4712-ae49-dc762c98fb66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:41.804576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:41.805680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:41.806660 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:41.813977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 285/587] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:41.813977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375a7c-68f3-4e10-9668-46e7b96ac1f2 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.813977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375a7c-68f3-4e10-9668-46e7b96ac1f2 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.813977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375a7c-68f3-4e10-9668-46e7b96ac1f2 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.815625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 286/588] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:41.816275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375a7c-68f3-4e10-9668-46e7b96ac1f2 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:41.817712 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-006b0e4d-6fa4-459f-9557-20e24b34c933 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:41.819150 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-006b0e4d-6fa4-459f-9557-20e24b34c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:41.840156 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:41.890730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 303/589] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:41.891900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.892275 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.892673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.915918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:41.917279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:41.937094 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375a7c-68f3-4e10-9668-46e7b96ac1f2 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:41.974457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:41.975292 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:41.975639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:41.976006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:41.976828 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:41.977197 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:41.978656 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e90d35-66fa-4294-8eee-6cf4ad84f924 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.001166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.004615 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 304/591] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:42.004732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 287/591] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:42.005532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.112122 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7aa68-7218-4a85-989f-6998fd536c3c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.139751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3e27-ea17-4828-9769-883d7b70d7b6 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.140034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3e27-ea17-4828-9769-883d7b70d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.140291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3e27-ea17-4828-9769-883d7b70d7b6 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.141947 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 288/592] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:42.148306 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.148596 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.148878 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.150252 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.151162 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.151653 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.151930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.165223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:42.167077 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.169546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:42.170847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:42.191638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:42.192608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:42.193548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:42.193548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:42.193548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:42.196671 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 305/593] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:42.203405 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.253962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 289/594] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:42.254814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.265887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.269688 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.329437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3e600-3f4d-41c4-a253-925bee7edb98 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.365951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.366551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.366833 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.367113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.367738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:42.368045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:42.369448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.375788 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af6eed-e5fe-480a-8db3-c203dd43f1f6 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.382422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 306/595] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:42.383547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.417914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.418547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.418830 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.419099 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.431882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:42.436955 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:42.437899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 290/596] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:42.438799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.496318 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8ee10-45b1-4a7f-b433-f2a7e0b24857 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.510842 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.514474 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.538168 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.538795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.539078 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.539356 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.548038 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba15b-9c5b-43db-84c0-53d23992f122 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.549829 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:42.554640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:42.555558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:42.556380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 307/597] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:42.557498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.589740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.590423 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.590634 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.590904 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.597859 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:42.599289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:42.610577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:42.612028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 291/598] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:42.613547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.660209 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360f04-923e-4eb2-b8aa-c007d8b0f409 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.692881 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.693428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.693710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.693986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.694896 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:42.695201 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:42.696559 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.704821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 308/599] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:42.706071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.713386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5421-378a-40ac-993a-b0395315d466 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.740630 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.743051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.748801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.749420 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.749698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.749969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.750619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:42.750919 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:42.752339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.760075 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 292/600] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:42.760880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.805881 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75736-f0a5-40ab-9bbe-f89303a77019 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.839572 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.840197 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.840457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.840900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.851306 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:42.856533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:42.857606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:31:42.858673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:42.859436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aee5be-4e17-4d20-80a5-0fa66525bcfc None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.862316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 309/601] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:42.863158 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.900187 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:42.900866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:42.901146 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:42.901414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:42.902132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:42.902437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:42.903856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:42.921087 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 293/602] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:42.921876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:42.962947 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:42.969805 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240aa1b-47f9-44cc-8ef7-f0e01351eab0 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:42.979555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.006353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.006966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.007245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.007516 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.019161 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.020617 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.029665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a4a0c-91a5-4301-a18e-4c5c6b8b4115 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:43.034784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:43.035862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:43.036742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:43.036742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.036742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:43.036742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 310/603] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:43.036742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.064909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.065526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.065801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.066071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.076049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.077527 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:43.091923 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:43.092988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:43.093872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:43.093872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.093872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:43.093872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 294/604] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:43.094093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.140330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14ea30-a4b5-48ac-bb04-ba70f96c2f66 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.172990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.173607 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.174427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.174696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.175341 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:43.175635 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.177046 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.184690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 311/605] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:43.185485 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.195845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.196715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63debd-4e71-4ba9-97e7-d895a7bafa8c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.199389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.230648 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.231151 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.231426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.231694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.284167 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480d77-afb7-4da0-94f6-bab6a2d86715 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.296347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.297811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.318129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.318724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.319003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.319531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.320164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:43.320466 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.321859 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.334208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 312/606] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:43.334994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.396850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 295/607] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:43.398089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.401740 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.402688 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.436376 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ed06-2ce0-441f-a058-3d93eb8bb6f9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.471445 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.472045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.472323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.472591 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.473248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:43.473549 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.474930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.486118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 313/608] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:43.486818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.499908 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e7ac-c012-432d-8de3-013ece959da9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.533759 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.534372 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.534644 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.534906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.544419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.545897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:43.560578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:43.566248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:43.567401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:43.567401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.567401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:43.567401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 296/609] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:43.567401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.585695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248467-5876-4b4f-a3a3-512b8d6b487d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.611904 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.616562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.620046 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.620666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.620971 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.621241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.628542 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.630011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:43.640649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:43.641726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:43.643374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 314/610] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:43.644209 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.663212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521fd8-34bb-4dc3-b7aa-6dfc2c32a281 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.696051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.696663 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.696974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.697256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.707448 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.708938 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:43.723256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:43.724417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:43.725496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:43.725496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:43.725496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:43.725496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 297/611] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:43.725776 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.745437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fe2c-a1ff-4a60-be9b-ec79a5237a40 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.778385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.778998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.779277 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.779553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.787399 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.788857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:43.799730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:43.800834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 315/612] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:43.802005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.826835 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3648-f29a-4573-85a1-d4a400013779 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.836566 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.852770 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:43.861517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.862111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.862386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.862661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.863290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:43.863595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.864992 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.876345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 298/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:43.877711 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.905329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0373f-1514-4a81-83c7-2e133d6c6cea None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:43.937863 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:43.938458 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:43.938739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:43.939012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:43.940242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:43.940547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:43.941997 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:43.958747 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 316/614] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:43.959605 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:43.978257 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab986386-b023-499c-a321-f489fb7a3fc0 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.015185 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.015728 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.016007 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.016279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.016940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:44.017245 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.018696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.030254 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 299/615] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:44.031155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.060087 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.064053 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84e7a9-ca60-4394-b171-a62af494e5a8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.072041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.099395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.099989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.100266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.100534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.101273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:44.101573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.102984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.120385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 317/616] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 10 20:31:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:44.121288 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.133723 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5a64-ad9e-4105-a2c0-56054437ab42 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.168070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.168689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.168992 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.169263 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.177239 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.178685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:44.190242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:44.191324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 300/617] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:44.192251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.217227 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148aa45-2d61-4525-964b-acca11807f5e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.250443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.251034 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.251310 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.251583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.279796 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.281838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.292893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c2ea4-2b0d-49b2-8b85-38d82b139b3f None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.318393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.320129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.325740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.326359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.326637 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.326908 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.334018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.335437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:44.346951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:44.347865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 301/618] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:44.348843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.421994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 318/619] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:44.422810 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.447491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704876a7-e063-4ce4-905e-2c73df7b6deb None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.480738 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.481364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.481646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.481922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.488227 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.499761 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.537096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb8c68-c69a-429c-92b8-d1d43f55e4c1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.555691 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.557218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.571405 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.571998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.572269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.572534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.573270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:44.573565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.574980 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.592342 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 319/620] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:44.593176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.655979 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 302/621] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:44.657273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.693858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885d64-41df-4668-aba2-f9f4f4ff7bef None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.703419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.716460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.729378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.729971 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.730272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.730545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.731253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:44.731553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.733005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.744310 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 320/622] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:44.745131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.752948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadec09a-644c-4020-9264-264fd943c755 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.786541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.787210 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.787440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.787709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.797366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.799360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:44.813668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:44.815214 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:44.816108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:44.816108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:44.816108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:44.816108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 303/623] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:44.816108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:44.844550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626bb50-89d7-4a92-ba7c-77c037735cc9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.882283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.882883 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.883165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.883441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.916692 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.919904 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec44c-fd80-46c0-84d9-edbd52d4426d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:44.931145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:44.951041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.952504 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.955673 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:44.956291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:44.956570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:44.956870 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:44.967030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:44.968481 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:44.982147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:44.983119 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:44.984658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:44.984658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:44.984658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:44.984658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 304/624] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:44.984658 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.050101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 321/625] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 10 20:31:45.050869 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.091010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119afa-78ad-402c-8f71-8fce1da42321 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.125580 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.126407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.126799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.127141 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.127922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:45.128305 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.129842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.132009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.136345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 305/626] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:44 2022] GET /identity/v3/role_assignments?user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:45.137320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.157081 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.162805 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb1968-7193-40f1-a3b2-6709cc764752 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.211598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.212317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.212660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.213042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.213768 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:45.214150 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.215637 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.236836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 322/627] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:45.236836 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.258916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a94b27-d705-4a7e-9c7f-28fb8317b61d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.300493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.301340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.301690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.301963 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.302649 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:45.302951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.304587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.323450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 306/628] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:45.323450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.353495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4ad9-119e-4ce5-b8cb-dadf280ab6a8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.393530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.394533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.395265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.395974 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.408977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.410644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.414671 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.416001 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:45.431183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:45.432171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:45.433189 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:45.433189 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:45.433189 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:45.433189 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 323/629] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:45.433624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.453928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b670b-b10f-4476-9f4d-8494ebc565d7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.494108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.494721 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.494995 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.495260 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.502726 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.504256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:45.515198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:45.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:45.517068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:45.521160 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 307/630] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:45.521993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.541443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13ea5-69cd-4cbd-83ab-fcd48e1d9874 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.580075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.580699 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.581007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.581290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.588255 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.589719 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:45.601545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:45.602537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:45.603457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:45.607414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 324/631] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:45.608056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.628051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbec7-327a-408a-966b-8e435905bd75 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.663819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.664704 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.665020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.665302 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.665760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.666122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:45.666435 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.669010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.671788 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.683616 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 308/632] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:45.684079 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.719821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7561e2-a918-4e43-8350-3db5a58d7b65 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.755156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.755782 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.756057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.756327 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.757034 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:45.757335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.758758 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.771447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 325/633] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:45.772239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.794772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83d0cc-4f62-42a4-830d-ea315eb37c81 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.835238 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.836129 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.836646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.837132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.837973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:45.838453 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.840056 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.853857 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 309/634] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:45.854737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.879900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85773ec-409f-4ad4-b01e-063da1508def None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:45.895318 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.916477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:45.918765 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:45.919471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:45.919788 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:45.920059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:45.927282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:45.928727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:45.940914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:45.941835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 326/635] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:45.942726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:45.965677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6795-1314-4c75-b5a6-0dc08e67b208 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:46.006876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:46.007472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:46.007746 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:46.008014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:46.008716 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=a2edea27275f4d75831629f1de22d43d) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:46.009050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:46.010466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:46.016351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 310/636] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/role_assignments?user.id=a2edea27275f4d75831629f1de22d43d&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:46.017013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:46.078513 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34676318-c363-4679-98bd-c144969a7c2a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:46.118649 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:46.119738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:46.120015 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:46.120282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:46.121108 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=6fbd946e624a40a5ba757daa22cec6f4) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:46.121421 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:46.122892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:46.132413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 327/637] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:45 2022] GET /identity/v3/role_assignments?user.id=6fbd946e624a40a5ba757daa22cec6f4&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:46.165213 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe37b-168c-45b3-8f5a-1536cdf4b41a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:46.190340 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:46.207920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:46.208901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:46.209343 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:46.209756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:46.210686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:46.211152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:46.212974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8852320-3f74-4997-b5cb-97627fda66fe None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:46.229105 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 311/638] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:46.239362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:46.290916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:46.365894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083e517-5f96-449b-879d-cfba64444d7d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:46.402250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:46.402780 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:46.403059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:46.403338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:46.404054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=1ae5691b5c9e45be9a585d5db0ab5cc9) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:46.404360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:46.405887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd02383-2aaf-4d5f-b31a-cee478a91779 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:46.412487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 328/639] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:46 2022] GET /identity/v3/role_assignments?user.id=1ae5691b5c9e45be9a585d5db0ab5cc9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:47.638320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022c5f-593d-4c02-93c2-86d8118590ee None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:47.638990 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022c5f-593d-4c02-93c2-86d8118590ee None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:47.638990 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022c5f-593d-4c02-93c2-86d8118590ee None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:47.640425 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 312/640] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:47.646029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:47.646441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:47.646632 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:47.665306 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:47.666483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:47.740965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 329/641] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:48.068768 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022c5f-593d-4c02-93c2-86d8118590ee None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:48.175482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022c5f-593d-4c02-93c2-86d8118590ee None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:48.215309 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:48.215956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.216233 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.216500 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.229570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:48.234641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:48.235732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:48.237279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:48.241051 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 313/642] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:31:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:48.243235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:48.281951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:48.349988 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9812531-87d7-43bd-97bf-a5c420a03007 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:48.384982 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f976-ff14-4dec-983e-722de513087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:48.385581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f976-ff14-4dec-983e-722de513087a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.385853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f976-ff14-4dec-983e-722de513087a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.386117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f976-ff14-4dec-983e-722de513087a None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.386764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f976-ff14-4dec-983e-722de513087a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:48.387059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f976-ff14-4dec-983e-722de513087a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:48.388405 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f976-ff14-4dec-983e-722de513087a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:48.397456 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 330/643] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:48.402906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:48.447425 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:48.508625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a44522-5f27-4b1e-8ee0-f926d233a1f7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:48.550149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:48.551075 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.551497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.551934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.563327 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:48.565161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-db5aedc8-e597-4d5a-a63a-abf6f8b86f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:48.582905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:48.584122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:48.585230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:48.585230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:48.585230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:48.591266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 314/644] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:48.592764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f976-ff14-4dec-983e-722de513087a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:48.689578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:48.696050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f976-ff14-4dec-983e-722de513087a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:48.701103 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177794c9-0414-45a3-a548-05fd903a7d65 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.701571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177794c9-0414-45a3-a548-05fd903a7d65 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.701650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177794c9-0414-45a3-a548-05fd903a7d65 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.703222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 315/645] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:48.710352 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb26c9-ad22-410f-88aa-984aa20c6fd3 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.710747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb26c9-ad22-410f-88aa-984aa20c6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.711115 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb26c9-ad22-410f-88aa-984aa20c6fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.729764 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-bdeb26c9-ad22-410f-88aa-984aa20c6fd3 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:48.731165 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-bdeb26c9-ad22-410f-88aa-984aa20c6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:48.734499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:48.735099 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.735378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.735650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.736308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:48.736609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:48.737995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113264f-2b07-4d0f-bff0-01757c7d7ad7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:48.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 331/646] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:48.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8989787-9fa2-4c80-afac-af3c5d2f4b10 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8989787-9fa2-4c80-afac-af3c5d2f4b10 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8989787-9fa2-4c80-afac-af3c5d2f4b10 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 332/647] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:48.758732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8989787-9fa2-4c80-afac-af3c5d2f4b10 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:48.800070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 316/648] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:48.801683 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.802185 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.802661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.825362 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:48.826902 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:48.858131 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:48.878384 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8989787-9fa2-4c80-afac-af3c5d2f4b10 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:48.924815 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 317/649] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:48.925005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:48.925554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:48.925831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:48.926156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:48.933647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:48.935087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-8d5c6a5f-c16e-4933-93c6-7834727ea4d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:48.947867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:48.948832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:48.949816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 333/650] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 10 20:31:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:31:48.956701 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.012925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a277f4c-94dd-4588-abb8-f8ce0ca2d670 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.013139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a277f4c-94dd-4588-abb8-f8ce0ca2d670 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.013410 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a277f4c-94dd-4588-abb8-f8ce0ca2d670 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.014981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 334/651] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:49.019771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.020048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.020320 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.046464 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:49.047825 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:49.060664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.088084 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e86175-d32f-4591-8dce-2f763fde7aa0 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.125711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 335/652] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:49.138556 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.139219 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.139505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.139779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.140502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:49.140828 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.142721 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.143171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.163904 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 318/653] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 10 20:31:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:49.169403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.184284 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.258885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f69a-71fa-454d-b819-b48b41c9165c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.292154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c99b9f-f3da-4523-9534-eda2db11f79c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.297871 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.298540 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.298823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.299264 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.299679 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.301086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:49.312005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:49.317056 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.317932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 336/654] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:31:49.318724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.326614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.336699 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.337343 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.337622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.337890 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.405513 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.406978 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.417442 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48305f-3c7f-4047-a617-4ecebad0e8f1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.418649 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.455418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.455965 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.456250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.456528 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] PATH_INFO: `/v3/services/image` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.457311 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.459090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:49.468102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:49.473139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.474033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 337/655] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:49.474849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.519332 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 319/656] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 10 20:31:49.520441 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.549515 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.580197 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a000-c1b7-4098-bfde-7281881b5c37 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.613029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.613634 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.613930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.614199 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.614817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:49.615119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.616489 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.616617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82706-9141-4e9f-96e3-0d86e3ebb9b2 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.620780 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 338/657] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:49.621831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.630968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.654620 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.655227 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.655504 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.655786 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.656517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] RBAC: Adding query filter params (name=image) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:49.656879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.659089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.663462 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 320/658] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:49.664232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.728812 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1fb4c-210a-4abd-8072-ab98b6c88777 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.762624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.763241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.763367 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101d6e-4f43-4542-9f93-b87fa1b961fe None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.763764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.763764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] PATH_INFO: `/v3/services/network` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.764324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.765738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.768224 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:49.774908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:49.776075 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:31:49.777114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:49.779416 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 339/659] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:49.780646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.797266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.797883 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.798222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.798494 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.808153 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.809542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:49.824698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:49.825674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:49.826546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:49.826546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:49.826546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:49.826546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 321/660] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:49.826778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.853534 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:49.885119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285e4e7-8dff-4b13-8565-bd5f89b5e480 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.918179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.918774 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.919049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.919322 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.919935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:49.920233 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.921613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.925316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018acce-0ca8-4b55-8957-2071c050a3aa None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:49.927452 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 340/661] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:49.928237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:49.964565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:49.965596 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:49.966054 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:49.966502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:49.967729 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] RBAC: Adding query filter params (type=image) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:49.968044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:49.969758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:49.976933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 322/662] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:49.977854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:50.025888 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:50.089674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80c96d-e3be-4e38-a72a-45504452d078 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:50.098178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:50.111661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53201027-b981-47b6-be07-39d3d54b5d99 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:50.149729 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:50.150618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:50.151019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:50.151359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:50.152232 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:50.152610 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:50.154412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:50.155466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:50.156359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:50.156895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:50.157369 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:50.158301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:50.158827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:50.159832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 341/663] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:50.161463 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:50.166707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:50.176643 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 323/664] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:50.183029 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:50.305021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b00f7-cf98-427f-834f-190edcd19652 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:50.305230 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2495d7-9bce-4fed-b1a9-aa1964c906d9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:50.336660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:50.342707 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:50.343270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:50.343546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:50.343813 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:50.347871 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:50.348647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:50.349102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:50.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:50.350327 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] RBAC: Adding query filter params (type=network) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:50.350774 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:50.351150 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:50.352454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:50.352588 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:50.363666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 342/665] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:31:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:50.364732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:50.365798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:50.366922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 324/666] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:50.378176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:50.496347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3917ff-33ba-4c51-af1f-73c67dde6375 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:50.536309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:50.537225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:50.537657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:50.538079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:50.538951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:50.539423 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:50.541146 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c13d5-6277-48bd-ad05-9059b2e4a43a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:50.556017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 343/667] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:50.562426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:50.578412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:50.676473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0921a3-eb0c-4322-a336-af8bea79819c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:50.712012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:50.712991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:50.713488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:50.713953 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:50.714859 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:50.715391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:50.717065 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9ef3-d5a9-423b-8c62-2aab48057afa None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:50.723700 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 325/668] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:31:50 2022] GET /identity/v3/role_assignments?user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:52.537792 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa64c-d864-46c7-8a6c-1c8bc113516b None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:52.538315 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa64c-d864-46c7-8a6c-1c8bc113516b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:52.538315 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa64c-d864-46c7-8a6c-1c8bc113516b None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:52.539939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 344/669] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:52.545457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43543c6-3217-4dbe-b26f-0333f5380add None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:52.545914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43543c6-3217-4dbe-b26f-0333f5380add None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:52.546013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43543c6-3217-4dbe-b26f-0333f5380add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:52.564858 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-c43543c6-3217-4dbe-b26f-0333f5380add None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:52.566075 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-c43543c6-3217-4dbe-b26f-0333f5380add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:52.582560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbaa0-a873-4d46-844d-8cbddcf3669c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:52.582864 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbaa0-a873-4d46-844d-8cbddcf3669c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:52.583099 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbaa0-a873-4d46-844d-8cbddcf3669c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:52.584678 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 345/670] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:52.589448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fca546-bae4-4bd1-b080-a3398c05ab3b None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:52.589726 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fca546-bae4-4bd1-b080-a3398c05ab3b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:52.589998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fca546-bae4-4bd1-b080-a3398c05ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:52.609514 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-86fca546-bae4-4bd1-b080-a3398c05ab3b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:52.610723 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-86fca546-bae4-4bd1-b080-a3398c05ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:52.647832 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 326/671] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:52.670302 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:52.684301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 346/672] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:52.893255 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4364ef-9256-460a-99b8-e0c5a952af97 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:52.893648 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4364ef-9256-460a-99b8-e0c5a952af97 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:52.893821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4364ef-9256-460a-99b8-e0c5a952af97 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:52.895529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 327/673] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:52.901484 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:52.901822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:52.902043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:52.922763 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:52.924069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:52.969677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4364ef-9256-460a-99b8-e0c5a952af97 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:52.973956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:52.996050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 347/674] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 10 20:31:53.024894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:53.122914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4364ef-9256-460a-99b8-e0c5a952af97 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:53.172016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:53.173733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:53.175005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:53.177207 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:53.178040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:53.179439 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:53.203554 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 328/675] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:31:52 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:31:53.236265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0788a-2a5d-4469-b6d7-7d7335517089 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:53.253628 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:53.295635 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2bc0-cd25-422d-8356-bdb972fabe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:53.296315 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2bc0-cd25-422d-8356-bdb972fabe36 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:53.296604 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2bc0-cd25-422d-8356-bdb972fabe36 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:53.296950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2bc0-cd25-422d-8356-bdb972fabe36 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:53.297621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab2bc0-cd25-422d-8356-bdb972fabe36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:53.299681 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab2bc0-cd25-422d-8356-bdb972fabe36 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:53.320534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 348/676] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:31:53 2022] POST /identity/v3/services => generated 242 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:31:53.355836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:53.363829 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a78bf-497c-41c9-ab5d-e1e4789e9c0f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:53.364164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a78bf-497c-41c9-ab5d-e1e4789e9c0f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:53.364389 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a78bf-497c-41c9-ab5d-e1e4789e9c0f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:53.366242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 349/677] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:53.372151 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:53.372461 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:53.372699 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:53.393498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:53.394838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:53.443040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:53.495086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 350/678] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:53 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 10 20:31:53.504821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0dd7e-e62e-407b-a6b5-29d8358ca280 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:53.543595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:53.544207 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:53.544486 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:53.544758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:53.545436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:53.546987 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:53.564860 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 329/679] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:31:53 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:31:53.831326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:53.928680 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:53.935208 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92aaba-6d0a-4cb6-bedc-b51b725e4738 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:53.978219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:53.978861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:53.979147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:53.979417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:53.991136 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:53.996086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:53.997031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:53.997861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 351/680] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:54.006134 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:54.118889 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebd86-af30-4d01-976a-10af84099b72 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:54.143584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:54.157176 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:54.157824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:54.158100 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:54.158366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:54.159021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:54.159319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:54.160751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:54.169937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 330/681] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:54.176005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:54.278231 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994a1f-da74-4a1e-8bed-11c105219593 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:54.313164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:54.314305 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:54.314611 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:54.314885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:54.325276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:54.326748 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:54.342379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:54.343346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:54.344222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:54.344222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:54.344222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:54.344222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 352/682] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:54.349880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:54.463446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c29601-3862-4663-a039-c319b6e7db82 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:54.499045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:54.499651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:54.499927 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:54.500194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:54.501401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:54.501718 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:54.503082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:54.515795 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 331/683] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:54.521673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:54.524818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:54.762236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cab37-fcb1-47fc-9e0e-27a04911db9d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:54.802308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:54.803009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:54.803297 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:54.803573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:54.811011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:54.812462 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:54.826244 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:54.827184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 353/684] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 10 20:31:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:54.834096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:54.897868 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:54.940034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22acca-8703-4870-b8c2-9e5276a032a7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:54.990162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:54.990784 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:54.991063 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:54.991339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:54.992072 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:54.992375 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:54.993919 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:55.012959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 332/685] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 10 20:31:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:55.018012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:55.080157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:55.120078 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43dc5-5c4d-4341-af53-8654f890e6d4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:55.154086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:55.154705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.154983 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.155256 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.166217 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:55.167695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:55.181608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:55.182550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:55.183446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:55.183446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:55.183446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:55.183446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 354/686] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:31:55.189937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:55.295564 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b5e9-ade3-4b79-9758-051ea80ad61c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:55.297912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:55.330781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:55.331381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.331662 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.331932 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.332564 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:55.332893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:55.334261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:55.346262 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 333/687] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:55.353893 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:55.456505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf62d5-78c3-4cc3-a17e-0219b0fb9947 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:55.473919 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:55.503195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:55.503835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.504115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.504388 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.511645 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:55.513282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:31:55.525333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:55.526241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:55.527117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 355/688] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:55.532501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:55.637517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395db43-041f-4da7-adc5-d172317ac283 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:55.671525 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:55.672502 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.673049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.673533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.674403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:55.674920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:55.676555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b650d4-d427-4056-b937-375c06ec7604 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:55.689653 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 334/689] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:55.695331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:55.805506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf1ed-423b-4dee-86dd-8f562d0a6c50 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:55.839934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99bf8-b8bb-426a-b7fe-cbe4b137ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:55.840594 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99bf8-b8bb-426a-b7fe-cbe4b137ab95 None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.841019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99bf8-b8bb-426a-b7fe-cbe4b137ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.841300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99bf8-b8bb-426a-b7fe-cbe4b137ab95 None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/b4ff9eb972fa48f8ad0c32fa56f11fe9/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.843226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99bf8-b8bb-426a-b7fe-cbe4b137ab95 None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=b4ff9eb972fa48f8ad0c32fa56f11fe9, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:55.845200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99bf8-b8bb-426a-b7fe-cbe4b137ab95 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:55.865568 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 356/690] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:31:55 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/b4ff9eb972fa48f8ad0c32fa56f11fe9/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:31:55.938897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8989-864e-4b78-8879-b4d71c8cbc62 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.939953 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8989-864e-4b78-8879-b4d71c8cbc62 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.940431 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8989-864e-4b78-8879-b4d71c8cbc62 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.942461 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 335/691] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:55.948839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017819d-c628-43c4-a743-d692efebaf18 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.949149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017819d-c628-43c4-a743-d692efebaf18 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.949409 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017819d-c628-43c4-a743-d692efebaf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.970321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-8017819d-c628-43c4-a743-d692efebaf18 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:55.971920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-8017819d-c628-43c4-a743-d692efebaf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:55.973110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb01b-8309-48ae-8b0d-0a4b25c1fb6f None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.973625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb01b-8309-48ae-8b0d-0a4b25c1fb6f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.974106 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb01b-8309-48ae-8b0d-0a4b25c1fb6f None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:55.975974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 336/692] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:31:55.993777 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062827aa-04ac-4c20-94b9-a67a5c914027 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:55.994296 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062827aa-04ac-4c20-94b9-a67a5c914027 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:55.994872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062827aa-04ac-4c20-94b9-a67a5c914027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.003211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:56.022387 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-062827aa-04ac-4c20-94b9-a67a5c914027 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:56.025882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-062827aa-04ac-4c20-94b9-a67a5c914027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:56.052839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 357/693] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:31:56.057185 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:56.110853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 337/694] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:31:56.168518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243cb1-5c0c-4f7c-9a98-f3c9909de8a6 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.168877 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243cb1-5c0c-4f7c-9a98-f3c9909de8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.169111 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243cb1-5c0c-4f7c-9a98-f3c9909de8a6 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.170705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 358/695] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:56.176507 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.176821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.177112 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.195722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:56.196863 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:56.267216 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 338/696] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:31:56.392170 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243cb1-5c0c-4f7c-9a98-f3c9909de8a6 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.455801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.498000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243cb1-5c0c-4f7c-9a98-f3c9909de8a6 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:56.534440 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:56.535070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.535350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.535620 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] PATH_INFO: `/v3/services/image` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.536194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:56.537714 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:56.550274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:56.551259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:31:56.552411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 359/697] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:56.557022 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.560760 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:56.583525 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cc83c-ce07-4761-8800-7c7437892b2a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:56.601068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:56.623767 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:56.624409 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.624672 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.624977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.625549 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:56.627451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:56.637952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:56.638993 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:56.639845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 339/698] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:56.640639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.681001 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2df0e-4833-45a7-b04c-b256b08eb21a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:56.717360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:56.718689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.718980 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.719258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.719919 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] RBAC: Adding query filter params (name=image) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:56.720225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:56.721625 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:56.727099 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 360/699] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:31:56.728983 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.752594 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef29b3-71d3-4f29-94a3-7613006e7d94 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:56.788622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:56.789275 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.789551 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.789839 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.790414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:56.791790 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:56.800948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:56.801928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:31:56.802793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:56.806820 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 340/700] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:56.807654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.824346 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:56.828072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:56.838248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467373c-098f-43a1-adc4-a633395eac27 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:56.876240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:56.877164 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.877449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.877769 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.878398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:56.878705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:56.880341 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:56.890101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 361/701] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:56.890101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:56.915942 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37719e-42ac-4294-9dc4-d4fed1aae0b5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:56.950943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:56.951573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:56.951815 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:56.952091 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:56.952713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:56.953047 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:56.954979 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:56.959909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 341/702] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:56.960684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.014137 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161645e9-d220-4891-9dec-6278ec3d5a67 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.051358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.051769 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.052050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.052324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.052977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] RBAC: Adding query filter params (name=network) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:57.053506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.054648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.063988 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 362/703] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:57.063988 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.067393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:57.093350 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a949a-c120-4eeb-af87-86eb0665bec3 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.094388 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:57.131249 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.132108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.132545 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.132836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.133571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:57.133873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.135475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.144826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 342/704] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 10 20:31:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:57.144826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.184695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e09e-216f-4066-bd40-4eb99c4cf0a5 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.220565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.221306 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.221589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.221978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.222676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] RBAC: Adding query filter params (interface=public, service_id=2cd7cda27c1743d8af5a9024151fda74, region_id=RegionOne) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:57.222978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.224347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.232532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 363/705] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/endpoints?service_id=2cd7cda27c1743d8af5a9024151fda74&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:57.233389 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.256533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492ff2-684a-441d-a281-a545dbf32f5e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.291461 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.292066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.292352 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.292627 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.293274 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] RBAC: Adding query filter params (type=network) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:57.293579 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.294943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.304202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 343/706] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:57.304202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.305742 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:57.328717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:57.346312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40596ae-f493-43d1-8810-1236138e42c1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.382339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.382943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.383218 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.383483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.384175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] RBAC: Adding query filter params (interface=public, service_id=2d19b83e32834a30a8ed7b7ea4a70a70, region_id=RegionOne) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:57.384597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.386094 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.391586 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 364/707] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/endpoints?service_id=2d19b83e32834a30a8ed7b7ea4a70a70&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:57.392353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.408135 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e22c55-795a-4938-9d73-4bae115b5e3d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.444521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.445147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.445427 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.445697 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.446295 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.447654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.452903 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 344/708] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/services => generated 1002 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:31:57.452903 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.514092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7504e3-3e93-4928-83ba-9f64c799809d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.550521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:57.559809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.560524 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.560905 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.561250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.562024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] RBAC: Adding query filter params (interface=public, service_id=696128ddf55c4a78b86713f915b2a81c, region_id=RegionOne) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:57.562400 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.563934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.570499 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 365/709] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/endpoints?service_id=696128ddf55c4a78b86713f915b2a81c&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:57.576065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:57.601118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:57.612475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f5a5-a12b-40de-b0a0-8b8ac2ea846d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.654850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388506-3a92-4b6f-b8e8-cdb5e8af1d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.655865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388506-3a92-4b6f-b8e8-cdb5e8af1d38 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.656625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388506-3a92-4b6f-b8e8-cdb5e8af1d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.657479 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388506-3a92-4b6f-b8e8-cdb5e8af1d38 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.658455 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388506-3a92-4b6f-b8e8-cdb5e8af1d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.660293 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388506-3a92-4b6f-b8e8-cdb5e8af1d38 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.667755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 345/710] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/services => generated 1002 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:31:57.702050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304dea8-82a3-4899-93f9-92fa384ca007 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:57.745084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465b3d5-a166-4300-9fba-4780dc5a3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:57.745704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b3d5-a166-4300-9fba-4780dc5a3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:57.747363 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b3d5-a166-4300-9fba-4780dc5a3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:57.747363 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b3d5-a166-4300-9fba-4780dc5a3cc7 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:57.747363 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465b3d5-a166-4300-9fba-4780dc5a3cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:57.748256 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465b3d5-a166-4300-9fba-4780dc5a3cc7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:57.755098 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 366/711] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:31:57 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:31:58.366247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990e31-cf1e-40b2-b639-c01e0a27e790 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:58.366796 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990e31-cf1e-40b2-b639-c01e0a27e790 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:58.366796 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990e31-cf1e-40b2-b639-c01e0a27e790 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:58.368377 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 346/712] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:31:58.373874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:58.374281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:58.374401 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:58.393992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:31:58.395188 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:31:58.468906 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 367/713] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:31:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:31:58.790295 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990e31-cf1e-40b2-b639-c01e0a27e790 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:58.904204 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990e31-cf1e-40b2-b639-c01e0a27e790 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:58.935814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:58.942458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:58.943329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:58.944066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:58.944571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:58.955847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:31:58.960876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:58.961780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:31:58.962651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:58.965290 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 347/714] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:58.976372 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:58.990346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:59.089065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c1d4-7a56-413d-8e65-dba05d04a0c5 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:59.124356 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:59.124989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:59.125270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:59.125562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:59.126792 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:59.127396 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:59.130065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:59.139495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 368/715] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:59.146868 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:59.251968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3494b-9015-4f9e-89a4-1a98a264bc6e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:59.286897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:59.287524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:59.287801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:59.288074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:59.298112 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:59.299569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:31:59.314737 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:59.315894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:31:59.316949 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:31:59.316949 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:31:59.316949 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:59.320713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 348/716] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:59.322088 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:59.389779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:59.424074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c660a-ea51-43f1-ba53-3e226c90b644 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:59.458252 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:59.458855 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:59.459132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:59.459403 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:59.460028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:59.460323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:59.461702 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:59.475214 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 369/717] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:59.480489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:59.538574 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:59.603126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e14c9f-35e5-4e57-b22c-5a91d60da348 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:59.642698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:59.643257 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:59.643537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:59.643882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:59.652941 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:59.654576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:31:59.667443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:31:59.669873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:31:59.671997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 349/718] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 10 20:31:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:31:59.676838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:59.784483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ffe01-7ada-4e1f-a2b5-1cfd30858df5 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:59.812069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:31:59.820892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:31:59.821742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:31:59.822023 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:31:59.822294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:31:59.823010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:31:59.823312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:31:59.824724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bc71-2cba-4912-a6df-788928dd24a6 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:31:59.842783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 370/719] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 10 20:31:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:31:59.848270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:31:59.962962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656be7-a7af-4fb0-8507-1a254f4f403b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:31:59.965283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.002864 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eda51-2985-44e0-bd99-405841c802ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.003476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eda51-2985-44e0-bd99-405841c802ec None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.003755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eda51-2985-44e0-bd99-405841c802ec None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.004031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eda51-2985-44e0-bd99-405841c802ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.074126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eda51-2985-44e0-bd99-405841c802ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.075595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eda51-2985-44e0-bd99-405841c802ec None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.087091 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aee40-3b75-42ca-a940-bf42cc949f1c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.087379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aee40-3b75-42ca-a940-bf42cc949f1c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.087650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aee40-3b75-42ca-a940-bf42cc949f1c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.089000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 371/720] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:00.093951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.094256 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.094560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.113045 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:00.114241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:00.193191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 372/721] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:32:00.205897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 350/722] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:31:59 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 10 20:32:00.211357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.241253 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd28d6-5f4e-4baa-9e84-41539ba95db4 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.241538 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd28d6-5f4e-4baa-9e84-41539ba95db4 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.241702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd28d6-5f4e-4baa-9e84-41539ba95db4 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.243395 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 351/723] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:32:00.250117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f934b-5f82-4f10-9d45-898274067f45 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.250409 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f934b-5f82-4f10-9d45-898274067f45 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.250719 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f934b-5f82-4f10-9d45-898274067f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.259215 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.274616 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-a78f934b-5f82-4f10-9d45-898274067f45 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:00.276485 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-a78f934b-5f82-4f10-9d45-898274067f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:00.329721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f9521-568d-452b-bc2d-bd43a71c605d None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.349654 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.364121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 352/724] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:00.365639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2bac-3ca3-49bc-960c-460403301668 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.365930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2bac-3ca3-49bc-960c-460403301668 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.366220 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2bac-3ca3-49bc-960c-460403301668 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.367551 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 353/725] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:00.372387 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.372673 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.372976 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.380697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.381636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.382118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.382592 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.391847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:00.393035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:00.394163 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.397096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:32:00.415562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:00.416569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:32:00.417571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:32:00.417571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:32:00.417571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:00.420068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 373/726] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:00.427950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.473168 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 354/727] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:32:00.509458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.535040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dbf3f-146c-47a8-a695-c1a63b208884 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.581713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.582301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.582585 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.582862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.583766 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:00.584074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.585749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.586641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.613325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 374/728] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:00.615603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.633672 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fe27-25b3-4d65-a42c-971f62912b59 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.645014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.672920 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.673901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.673901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.674126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] PATH_INFO: `/v3/services/image` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.674496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.675991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:00.685584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:00.686642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:00.687482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 355/729] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:32:00.692606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.749890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2350b-7f18-4b5d-8984-500bc4d2ab57 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.787213 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.787754 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.788033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.788300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.795728 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.797205 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.798168 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce727e7-d1cc-473e-8677-57b062fa246c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:32:00.808493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:00.809581 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:00.810473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 375/730] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:00.810989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.829928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.838123 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.838725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.839000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.839265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.839889 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] RBAC: Adding query filter params (name=image) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:00.840182 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.841574 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.847188 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 356/731] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:00.847948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.900632 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:00.913539 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce4d1-636a-4171-aecf-b085eb5a8eae None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.946172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.946360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420f9e-f5bd-4732-acfc-706db1dcd981 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:00.946795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.947070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.947338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.948065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.949471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:00.958845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:00.960036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:00.960891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 376/732] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:00.961703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:00.984267 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:00.985510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:00.985636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:00.985870 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] PATH_INFO: `/v3/services/network` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:00.986517 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:00.987912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:00.997250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:00.998391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:00.999258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 357/733] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:01.000451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.054124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.061609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7732-e16b-48de-be36-74181e53c37a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.096230 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.096840 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.097116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.097382 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.098050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.098348 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.098472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e573-a04b-4086-b9b8-781068cf77de None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.099762 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.111447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 377/734] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.112062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.125987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.138254 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.138854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.139126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.139398 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.140041 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] RBAC: Adding query filter params (type=image) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.140341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.141795 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.146374 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 358/735] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:32:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.147143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.210186 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34514be2-c6b1-4bda-9219-b7f6fca7e134 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.242984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.243573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.243850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.244121 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.244731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.245061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.246438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.251103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 378/736] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 10 20:32:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.251695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.253532 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb303c7-9e20-48b5-8839-ee1fe60f7097 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.274287 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.289627 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.290231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.290528 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.290796 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.291408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] RBAC: Adding query filter params (name=network) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.291706 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.293110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.298033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 359/737] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.298778 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.329876 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.354062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc7d17-e63e-4d94-9b70-01363917a700 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.387074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.387676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.387949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.388220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.388959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.389263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.390678 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.396380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751efb3-a228-469f-bf1d-5eb37fe49e91 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.396505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 379/738] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:32:01 2022] GET /identity/v3/role_assignments?user.id=b4ff9eb972fa48f8ad0c32fa56f11fe9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.397105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.436409 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.437126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.437443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.437732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.438498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.440015 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.466320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 360/739] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:32:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:32:01.467041 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.520107 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.564572 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bb3b4-a6a2-4a84-80e0-7b4809ed5642 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.615300 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e69d-96b3-47f4-9987-c42d1b1398a6 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.617118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.617853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.618298 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.618642 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.620451 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.620451 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.622061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.625917 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.635136 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 380/740] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 10 20:32:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.642349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.664678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.665401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.665685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.665985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.667587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] RBAC: Adding query filter params (type=network) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:01.667587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.668733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.676289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 361/741] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:01.682453 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:01.773796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb640a4-0c32-4ca0-a5ea-b342172c8bfc None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.798279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:01.801538 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c2b4-4875-4519-973c-ee1f0855b4ab None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:01.819985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d319a13-a79b-424f-93ab-fd1554de8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.821112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d319a13-a79b-424f-93ab-fd1554de8372 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.821977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d319a13-a79b-424f-93ab-fd1554de8372 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.822426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d319a13-a79b-424f-93ab-fd1554de8372 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.823272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d319a13-a79b-424f-93ab-fd1554de8372 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.825370 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d319a13-a79b-424f-93ab-fd1554de8372 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.839743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88920e52-2879-4c45-9ded-3b4c549631da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:01.840448 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920e52-2879-4c45-9ded-3b4c549631da None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:01.840829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920e52-2879-4c45-9ded-3b4c549631da None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:01.841351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920e52-2879-4c45-9ded-3b4c549631da None admin] PATH_INFO: `/v3/endpoints` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:01.842199 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88920e52-2879-4c45-9ded-3b4c549631da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:01.843897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88920e52-2879-4c45-9ded-3b4c549631da None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:01.853392 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 381/742] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:32:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:32:01.875419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 362/743] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:32:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:32:03.925175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddabc0-152b-4b68-8048-d64f8ec53700 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:03.925704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddabc0-152b-4b68-8048-d64f8ec53700 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:03.925704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddabc0-152b-4b68-8048-d64f8ec53700 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:03.927212 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 382/744] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:03.932578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507302-d960-4260-a2ba-ed20649af44b None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:03.933030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507302-d960-4260-a2ba-ed20649af44b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:03.933231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507302-d960-4260-a2ba-ed20649af44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:03.951717 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-7d507302-d960-4260-a2ba-ed20649af44b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:03.952935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-7d507302-d960-4260-a2ba-ed20649af44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:04.014817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a78796-7a57-480f-9ada-fd1cc4e0d8ad None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.015153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a78796-7a57-480f-9ada-fd1cc4e0d8ad None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.015359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a78796-7a57-480f-9ada-fd1cc4e0d8ad None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.016712 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 383/745] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:32:04.021930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd081ac-f202-480d-ae46-f8462893bf2b None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.022218 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd081ac-f202-480d-ae46-f8462893bf2b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.022495 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd081ac-f202-480d-ae46-f8462893bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.036836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 363/746] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:04.041250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2dd081ac-f202-480d-ae46-f8462893bf2b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:04.042525 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2dd081ac-f202-480d-ae46-f8462893bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:04.097107 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:04.120853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 384/747] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:04 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:32:04.344446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c39bf5-bb01-40b9-9013-5a3f644d5603 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.344834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c39bf5-bb01-40b9-9013-5a3f644d5603 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.345044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c39bf5-bb01-40b9-9013-5a3f644d5603 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.346547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 364/748] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:04.351553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.351838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.352106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.355764 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c39bf5-bb01-40b9-9013-5a3f644d5603 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.370648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:04.371835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:04.442165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 385/749] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:04 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:04.443331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:04.447355 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.466339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c39bf5-bb01-40b9-9013-5a3f644d5603 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:04.505390 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:04.506009 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.506284 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.506549 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.507116 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:04.508594 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:04.517698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:04.518664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:04.519847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 365/750] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:32:04.524513 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.568359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada3bd6-d8cc-4636-8c30-c48ab426791b None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:04.586267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:04.605266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:04.605793 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.606064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.606362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.632645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30ae77-d88c-4d1e-99b8-ebad80a06d37 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:04.670209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:04.670873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.671151 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.671422 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.672533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:04.672865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:04.674233 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:04.678890 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 366/751] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:04.684364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.691219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:04.692666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:04.697162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:04.790251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d8b-e5f0-4f6a-9bb4-f06e1bc032ed None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:04.794771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 386/752] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 10 20:32:04.795620 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.826282 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:04.827997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:04.828894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.829322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.829734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.830678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:04.831145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:04.833463 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:04.837688 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 367/753] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:04.838472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.918865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:04.930605 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fefdbb-e956-4e30-b312-9cb8bddba06d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:04.951320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d54fa-ba08-42be-95de-13ce8ffbff66 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:04.971428 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:04.972069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.972344 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.972612 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:04.973252 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:04.974630 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:04.984211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:04.986658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:04.987511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 387/754] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:04.991832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:04.998344 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:04.998982 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:04.999260 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:04.999529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:05.011030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:05.012510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:32:05.028652 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:05.029705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:32:05.030603 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:32:05.030603 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:32:05.030603 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:05.030603 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 368/755] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:05.036268 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:05.091607 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:05.112545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c713864-bdf6-42b6-9237-cc358e6c76ba None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:05.147013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9fe8-693f-4349-b102-d2ea9347bfbd None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:05.149721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:05.150479 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:05.150764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:05.151040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:05.151715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:05.152025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:05.153451 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:05.158537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 388/756] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:05.164406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:05.178222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:05.187657 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:05.188783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:05.189096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:05.189371 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:05.190008 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:05.190316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:05.191689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c580bd5-2561-42c5-a99f-5d19e3e730a6 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:05.212824 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 369/757] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:05.278705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc985e7-9968-4f3d-91fa-94d3c21bc4dd None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:05.314993 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:05.315609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:05.315884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:05.316152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:05.316783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:05.317119 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:05.318781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ec66-3ac6-4fff-9f69-ed4d601a798b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:05.333143 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 389/758] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:07.267679 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b9e7-40c1-475c-b133-683de8910de7 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:07.268198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b9e7-40c1-475c-b133-683de8910de7 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:07.268198 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b9e7-40c1-475c-b133-683de8910de7 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:07.269515 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 370/759] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:07.274584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147ff4a-1db7-4712-a70f-3687e96a5ba6 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:07.275013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147ff4a-1db7-4712-a70f-3687e96a5ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:07.275198 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147ff4a-1db7-4712-a70f-3687e96a5ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:07.294721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f147ff4a-1db7-4712-a70f-3687e96a5ba6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:07.296086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f147ff4a-1db7-4712-a70f-3687e96a5ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:07.299038 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:07.365176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 390/760] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:07 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:07.692805 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b9e7-40c1-475c-b133-683de8910de7 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:07.740916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da31ff-ca50-4af9-b337-1aea4c30125f None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:07.741200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da31ff-ca50-4af9-b337-1aea4c30125f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:07.741481 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da31ff-ca50-4af9-b337-1aea4c30125f None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:07.742809 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 391/761] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:32:07.747699 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:07.747984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:07.748262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:07.766665 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:07.767863 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:07.791576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b9e7-40c1-475c-b133-683de8910de7 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:07.824582 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5b665-ba5e-43d1-89ef-fbf0cb99925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:07.825221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b665-ba5e-43d1-89ef-fbf0cb99925f None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:07.825496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b665-ba5e-43d1-89ef-fbf0cb99925f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:07.825770 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b665-ba5e-43d1-89ef-fbf0cb99925f None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:07.826412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5b665-ba5e-43d1-89ef-fbf0cb99925f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:07.827791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5b665-ba5e-43d1-89ef-fbf0cb99925f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:07.833239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 392/762] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:07 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:32:07.851328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 371/763] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:32:07 2022] POST /identity/v3/services => generated 269 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:32:08.157839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:08.221553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:08.254251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0a01-819d-45d3-b0c8-b908b23cb3af None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:08.293160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c54dca-ed63-45de-88d3-3832843ca60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:08.293754 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c54dca-ed63-45de-88d3-3832843ca60c None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:08.294013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c54dca-ed63-45de-88d3-3832843ca60c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:08.294279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c54dca-ed63-45de-88d3-3832843ca60c None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:08.294916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c54dca-ed63-45de-88d3-3832843ca60c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:08.296259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c54dca-ed63-45de-88d3-3832843ca60c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:08.311824 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 393/764] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:32:08 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:32:10.278590 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccd8fa-606b-4657-9f76-958fa81d21f4 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:10.279089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccd8fa-606b-4657-9f76-958fa81d21f4 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:10.279089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccd8fa-606b-4657-9f76-958fa81d21f4 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:10.280368 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 372/765] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:10.286138 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7809-79cb-4c07-973b-85f60908f614 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:10.286660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7809-79cb-4c07-973b-85f60908f614 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:10.286660 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a7809-79cb-4c07-973b-85f60908f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:10.305807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-cd0a7809-79cb-4c07-973b-85f60908f614 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:10.307033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-cd0a7809-79cb-4c07-973b-85f60908f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:10.380222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 394/766] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:10.699040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccd8fa-606b-4657-9f76-958fa81d21f4 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:10.725014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb1c11-9f99-4571-89df-a276ed9da159 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:10.725299 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb1c11-9f99-4571-89df-a276ed9da159 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:10.725567 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb1c11-9f99-4571-89df-a276ed9da159 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:10.726880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 395/767] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:32:10.731888 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:10.732083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:10.732350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:10.747294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:10.751030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:10.752210 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:10.798738 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:10.804325 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccd8fa-606b-4657-9f76-958fa81d21f4 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:10.820887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 396/768] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:32:10.838631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:10.839250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:10.839529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:10.839801 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:10.840366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:10.841766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:10.850861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:10.851959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:10.853192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 373/769] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 10 20:32:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:10.857895 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:10.953676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b1444-c60a-4b7b-87cd-1f656327bbea None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:10.993417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:10.994011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:10.994284 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:10.994552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:10.995167 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:10.995462 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:10.996832 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.001335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 397/770] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 10 20:32:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:11.007048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.145149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.189821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:11.226142 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2b2b8-4292-4f99-b04c-a2412a289ef8 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.236895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:11.244657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf06f6d-dd7f-4342-9146-bfaf612c15f1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.263647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.264252 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.264533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.264830 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.265471 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:11.265768 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.267138 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.271814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 374/771] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:11.278241 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.279651 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.280276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.280554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.280944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.281520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.282883 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:11.292012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:11.293655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:11.294733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 398/772] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:32:11.299824 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.382531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a713c2-5d6e-41a6-8139-b22eecda6ea5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.397967 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd888f5-9a87-42a2-89db-8f70d62b8f14 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.406396 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:11.415505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.416104 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.416384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.416654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.417401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] RBAC: Adding query filter params (interface=public, service_id=9dc617d9aa1a48ada3e159b42ca22f0b, region_id=RegionOne) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:11.417706 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.419069 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.426653 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 375/773] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/endpoints?service_id=9dc617d9aa1a48ada3e159b42ca22f0b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:11.431418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.431830 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.432116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.432208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.432390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.433030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:11.433333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.434689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.439407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 399/774] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:11.445017 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.473961 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:11.532642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5421e2-ae09-4faa-9026-2238a0917d4d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.545888 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdc7d-f26e-48c5-b356-e630ebcce39a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.567065 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.567665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.567944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.568215 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.569118 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.570488 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.576289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 376/775] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:32:11.579970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.580573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.580886 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.581162 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.581789 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:11.582089 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.583481 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.589031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 400/776] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:11.595400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.702578 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43382-e0fb-4174-8664-4c61dc65131f None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.704973 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:11.740683 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.741353 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.741636 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.741909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.742611 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] RBAC: Adding query filter params (interface=public, service_id=7be3bd4805bf41cba058cbf7677cf08a, region_id=RegionOne) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:11.742915 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.744289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b5d53-6a00-4b05-85d7-0f6e250129a8 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.750785 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 377/777] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/endpoints?service_id=7be3bd4805bf41cba058cbf7677cf08a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:11.756609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:11.792956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:11.857120 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9a017-8d83-4849-a916-143dc177fea1 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:11.889975 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df55e5-65b5-4086-90e6-0f8df5446446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:11.890684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df55e5-65b5-4086-90e6-0f8df5446446 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:11.891034 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df55e5-65b5-4086-90e6-0f8df5446446 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:11.891382 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df55e5-65b5-4086-90e6-0f8df5446446 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:11.891987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df55e5-65b5-4086-90e6-0f8df5446446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:11.893384 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df55e5-65b5-4086-90e6-0f8df5446446 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:11.899165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 401/778] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:32:11 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:32:13.949086 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0c964-1f35-4ef5-a52a-bfbea515c331 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:13.949622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0c964-1f35-4ef5-a52a-bfbea515c331 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:13.949622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0c964-1f35-4ef5-a52a-bfbea515c331 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:13.951006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 378/779] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:13.956942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c84ff-0017-4e82-b21e-4699f7b10150 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:13.957392 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c84ff-0017-4e82-b21e-4699f7b10150 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:13.957609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c84ff-0017-4e82-b21e-4699f7b10150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:13.975245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-7e7c84ff-0017-4e82-b21e-4699f7b10150 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:13.976412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-7e7c84ff-0017-4e82-b21e-4699f7b10150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:14.041351 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 402/780] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:14.288671 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965c74e-4d3b-46ad-a716-28084602c5b2 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.289005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965c74e-4d3b-46ad-a716-28084602c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.289231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965c74e-4d3b-46ad-a716-28084602c5b2 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.290556 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 379/781] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:14.295762 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.296070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.296865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.314872 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:14.316033 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:14.338406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:14.375494 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965c74e-4d3b-46ad-a716-28084602c5b2 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:14.380730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 403/782] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:14.483225 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965c74e-4d3b-46ad-a716-28084602c5b2 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:14.515844 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:14.516456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.516732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.517047 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.517616 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:14.518964 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:14.527428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:14.528734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:14.529899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 380/783] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 10 20:32:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:32:14.534983 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:14.637083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853537c-0c44-4ad9-9f73-cbb68e222422 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:14.671995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:14.672587 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.672898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.673172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.673787 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:14.674083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:14.675430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:14.679890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 404/784] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 10 20:32:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:14.685563 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:14.710380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:14.718945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:14.734795 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:14.788581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab584-89b8-46fc-a80f-c3bddda2c9fb None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:14.808664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad683dc5-bd6c-4e60-acf8-dcf6d68f67bd None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:14.821651 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:14.822244 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.822516 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.822781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.823389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:14.823683 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:14.825065 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:14.830440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 381/785] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 10 20:32:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:14.836022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:14.842550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:14.843176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.843460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.843730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.844301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:14.845663 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:14.854131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:14.855251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:14.856072 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 405/786] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:32:14.861404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:14.926410 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:14.935829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f8861-015d-4188-b060-ac9dbb2c9a7d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:14.949149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:14.961973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa8cd-6c52-4e0e-9de1-87db6088c2bf None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:14.970964 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:14.971569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:14.971847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:14.972117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:14.972840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:14.974212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:14.995836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 382/787] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:32:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:32:15.009070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:15.009689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:15.009967 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:15.010233 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:15.010867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:15.011165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:15.012569 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:15.018522 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 406/788] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:15.024505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:15.130627 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8e967-4fe8-4d89-8979-29b4b90b44a7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:15.167300 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:15.167915 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:15.168195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:15.168466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:15.169135 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:15.169435 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:15.170890 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8cd87-c0b1-442b-986d-da95e3dad8c7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:15.176298 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 383/789] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 10 20:32:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:15.182416 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:15.283903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f41c83-53e9-4df0-9c5a-910721849ade None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:15.316454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f413d3-68fd-4c77-a7bd-71d869e3ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:15.317087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f413d3-68fd-4c77-a7bd-71d869e3ac12 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:15.317367 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f413d3-68fd-4c77-a7bd-71d869e3ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:15.317637 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f413d3-68fd-4c77-a7bd-71d869e3ac12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:15.318564 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f413d3-68fd-4c77-a7bd-71d869e3ac12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:15.319930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f413d3-68fd-4c77-a7bd-71d869e3ac12 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:15.341804 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 407/790] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:32:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:32:17.446186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cd36-f74f-4559-bc4a-4c7a80811f24 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:17.446715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cd36-f74f-4559-bc4a-4c7a80811f24 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:17.446805 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cd36-f74f-4559-bc4a-4c7a80811f24 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:17.448067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 384/791] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:17.453260 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795baa-60d3-490d-bb68-87939b50e380 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:17.453655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795baa-60d3-490d-bb68-87939b50e380 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:17.453924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795baa-60d3-490d-bb68-87939b50e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:17.461759 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:17.473252 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-d1795baa-60d3-490d-bb68-87939b50e380 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:17.474444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-d1795baa-60d3-490d-bb68-87939b50e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:17.543696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 408/792] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 10 20:32:17.743647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1c85a-cfab-4df5-a3fa-c8616394a0a5 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:17.743952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1c85a-cfab-4df5-a3fa-c8616394a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:17.744324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1c85a-cfab-4df5-a3fa-c8616394a0a5 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:17.745766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 385/793] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:17.751683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:17.751966 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:17.752238 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:17.770406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:17.771577 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:17.834791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 409/794] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:17.867172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1c85a-cfab-4df5-a3fa-c8616394a0a5 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:17.884606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:17.968682 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1c85a-cfab-4df5-a3fa-c8616394a0a5 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:18.003555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:18.004108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:18.004382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:18.004647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:18.005243 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:18.006581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:18.015509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:18.020962 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.021888 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 386/795] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:32:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:18.023877 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:18.080042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:18.118937 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c0bc-d028-44e4-814d-11ff377acf02 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:18.152024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:18.152613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:18.152926 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:18.153198 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:18.153807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:18.154103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:18.156039 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:18.160420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 410/796] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:18.163226 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:18.165822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:18.241505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:18.263599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bb39-ef47-44de-b7d8-917cc7996f94 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:18.263903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d87c7-c906-4379-ae9a-a114e57ffa50 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:18.287913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:18.298822 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:18.299410 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:18.299614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:18.299746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:18.299938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:18.300208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:18.300487 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:18.300578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:18.300760 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:18.300877 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:18.301436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:18.302227 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:18.302854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:18.305460 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING keystone.server.flask.common [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 10 20:32:18.306689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 411/797] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:18.324348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.sql.core [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 10 20:32:18.324348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 10 20:32:18.324348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [parameters: {'id': '47cbdd921bf4406cb339a84f19adb0e2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 10 20:32:18.324348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47cbdd921bf4406cb339a84f19adb0e2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47cbdd921bf4406cb339a84f19adb0e2. Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result = self._query(query) Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application conn.query(q) Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:32:18.344385 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result.read() Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 10 20:32:18.345391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application next(self.gen) Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application yield resource Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application next(self.gen) Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.session.rollback() Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.force_reraise() Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise self.value Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application session.commit() Sep 10 20:32:18.346341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._prepare_impl() Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.session.flush() Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._flush(objects) Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application compat.raise_( Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application flush_context.execute() Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 20:32:18.347754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rec.execute(self) Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 10 20:32:18.348687 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result = self._query(query) Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application conn.query(q) Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result.read() Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:32:18.349547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [parameters: {'id': '47cbdd921bf4406cb339a84f19adb0e2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.350477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:18.352483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47cbdd921bf4406cb339a84f19adb0e2. Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:18.353827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 387/798] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Sep 10 20:32:18 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:18.354642 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:18.456780 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982344f-c23a-49d7-bd7c-255e4ace1db2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:18.493235 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:18.493873 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:18.494148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:18.494417 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:18.501562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:18.503008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-c9b4a886-72dd-4466-94a0-74ed3e7787a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:32:18.514387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:18.515340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:18.521153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 412/799] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:18.523294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:18.622927 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba02c1-89ee-49e2-9a9e-9d7d54702d2b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:18.656515 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:18.657147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:18.657426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:18.657693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:18.658344 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:18.658645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:18.660271 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6124a-cb00-4a3b-96f5-f702cb8e365d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:18.661985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:18.681917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 388/800] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:32:20.814332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3315a0-af11-4301-a384-9bb527fd03c5 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:20.814885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3315a0-af11-4301-a384-9bb527fd03c5 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:20.814885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3315a0-af11-4301-a384-9bb527fd03c5 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:20.816194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 413/801] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:20.821995 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552de78-9eac-4438-a099-f9654579414f None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:20.822375 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552de78-9eac-4438-a099-f9654579414f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:20.822570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552de78-9eac-4438-a099-f9654579414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:20.841631 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-2552de78-9eac-4438-a099-f9654579414f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:20.843134 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-2552de78-9eac-4438-a099-f9654579414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:20.907661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 389/802] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:20 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:21.105377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdaea0-7b49-4fa5-a9ee-878d90b2774e None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:21.105658 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdaea0-7b49-4fa5-a9ee-878d90b2774e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:21.105923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdaea0-7b49-4fa5-a9ee-878d90b2774e None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:21.107271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 414/803] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:21.112476 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:21.112769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:21.113082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:21.130799 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:21.131979 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:21.196594 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 390/804] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:21 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:21.229328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdaea0-7b49-4fa5-a9ee-878d90b2774e None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:21.277234 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:21.327451 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdaea0-7b49-4fa5-a9ee-878d90b2774e None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:21.359190 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:21.359707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:21.359987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:21.360260 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:21.360940 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:21.362290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:21.376837 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 415/805] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:32:21 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:32:21.517348 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:21.573836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:21.619352 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf156a86-34e3-4c15-ae50-932c843322a1 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:21.658419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:21.659034 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:21.659330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:21.659887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:21.660881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:21.662928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:21.677470 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.sql.core [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 10 20:32:21.677470 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 10 20:32:21.677470 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [parameters: {'user_id': 'cd691f4cd6a6477eacb18392993e624b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 10 20:32:21.677470 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result = self._query(query) Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application conn.query(q) Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result.read() Sep 10 20:32:21.684321 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 10 20:32:21.685194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application next(self.gen) Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application yield resource Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application next(self.gen) Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.session.rollback() Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.force_reraise() Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise self.value Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application session.commit() Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 10 20:32:21.686318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._prepare_impl() Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.session.flush() Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._flush(objects) Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application compat.raise_( Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application flush_context.execute() Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rec.execute(self) Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 20:32:21.688014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:32:21.688929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result = self._query(query) Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application conn.query(q) Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application result.read() Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:32:21.689763 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cd691f4cd6a6477eacb18392993e624b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:21.690571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 10 20:32:21.691757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:21.693447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 391/806] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 10 20:32:21 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:21.693920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:21.793349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c6141-5100-4f1b-8d9a-ef663b66899e None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:21.802430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:21.828638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:21.829293 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:21.829555 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:21.829830 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:21.837068 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:21.838501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-de7fdcd1-a966-4a2e-a71f-195c0142359c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:32:21.849507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:21.850420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:21.852024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 416/807] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:32:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:21.856586 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:21.959530 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710801e3-d3e3-4a7b-96cd-44c87e1cd3ee None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:21.971879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:21.995531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:21.996139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:21.996418 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:21.996692 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:21.997414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:21.997716 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:21.999865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23c90-4c55-41b1-a3b2-f3d6f3dedc2e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:22.037023 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 392/808] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 10 20:32:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:23.799216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63c2c-6c14-462a-8d62-17939e850697 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:23.799745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63c2c-6c14-462a-8d62-17939e850697 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:23.799745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b63c2c-6c14-462a-8d62-17939e850697 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:23.801118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 417/809] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:23.806472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:23.806879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:23.807018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:23.825361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:23.827343 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:23.891213 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 393/810] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:23 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:24.214270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b63c2c-6c14-462a-8d62-17939e850697 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:24.309613 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b63c2c-6c14-462a-8d62-17939e850697 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:24.341650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:24.342247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:24.342549 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:24.342819 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:24.343375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:24.344718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:24.353142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:24.354267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:32:24.355090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 418/811] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:32:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:24.359934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:24.453416 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:24.456304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d6c5-578e-43e4-8396-ebb0f532a6cd None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:24.488743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:24.489304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:24.489581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:24.489849 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:24.490456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:24.490754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:24.492139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:24.496802 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 394/812] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:24.503008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:24.534283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:24.599678 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc1694-417e-4633-aafd-2cde6df79339 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:24.630885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:24.631455 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:24.631729 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:24.631996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:24.632599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:24.632919 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:24.634261 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:24.638814 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 419/813] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:24.645105 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:24.740880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11091782-da43-4560-8120-53dc0c009b9e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:24.773212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:24.773894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:24.774193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:24.774491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] PATH_INFO: `/v3/endpoints` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:24.775288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] RBAC: Adding query filter params (interface=public, service_id=339ba82417e642468b61a5e03b4c5366, region_id=RegionOne) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:24.775617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:24.776981 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49c84f-371c-42ef-90ad-c89b0f5d91df None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:24.782644 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 395/814] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:32:24 2022] GET /identity/v3/endpoints?service_id=339ba82417e642468b61a5e03b4c5366&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:24.788382 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:24.878629 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:24.884598 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505b39-28b2-4c98-b277-861ec259ae36 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:24.916285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff92756-d0fb-4c7d-92fe-64c89eacbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:24.916891 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff92756-d0fb-4c7d-92fe-64c89eacbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:24.917170 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff92756-d0fb-4c7d-92fe-64c89eacbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:24.917441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff92756-d0fb-4c7d-92fe-64c89eacbcc3 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:24.918027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff92756-d0fb-4c7d-92fe-64c89eacbcc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:24.919372 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff92756-d0fb-4c7d-92fe-64c89eacbcc3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:24.925831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 420/815] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:32:24 2022] GET /identity/v3/services => generated 1728 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:32:27.308150 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c430-e752-4c31-b3f2-5f63c2a005ef None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:27.308670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c430-e752-4c31-b3f2-5f63c2a005ef None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:27.308670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c430-e752-4c31-b3f2-5f63c2a005ef None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:27.309985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 396/816] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:32:27.315742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:27.316125 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:27.316281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:27.334648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:32:27.335817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:32:27.399901 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 421/817] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:32:27 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:32:27.718144 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c430-e752-4c31-b3f2-5f63c2a005ef None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:27.746073 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:27.818457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c430-e752-4c31-b3f2-5f63c2a005ef None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:27.851909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:27.852522 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:27.852826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:27.853099 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:27.853670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:27.855031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:32:27.864068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:32:27.865265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:32:27.866283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 397/818] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:32:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:32:27.871127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:27.955778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:27.965329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea241-a573-49bf-9c61-2519fd82be16 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:27.998500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:27.999088 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:27.999362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:27.999627 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:28.000237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:28.000532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:28.001917 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:28.006370 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 422/819] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:28.011995 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:28.098922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:28.107472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faea29c-3702-4add-80f0-354de123b1e9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:28.140650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:28.141265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:28.141542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:28.141811 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:28.142748 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:32:28.142748 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:28.144058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb6d3-3ed3-4619-a887-b23dc278ca22 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:28.149035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 398/820] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 10 20:32:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:32:28.154449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:32:28.249997 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081c2c-ea68-4e11-a7e3-76107581efe4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:32:28.281858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17df1-bf1a-4487-9861-56838159eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:32:28.282444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17df1-bf1a-4487-9861-56838159eaca None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:32:28.282722 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17df1-bf1a-4487-9861-56838159eaca None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:32:28.282990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17df1-bf1a-4487-9861-56838159eaca None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:32:28.283643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17df1-bf1a-4487-9861-56838159eaca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:32:28.285025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17df1-bf1a-4487-9861-56838159eaca None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:32:28.303274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 423/821] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:32:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:32:38.146722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=22 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:32:38.299097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:31.361840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01405ec-783b-42e6-a1cf-96c78d816731 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:31.362428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01405ec-783b-42e6-a1cf-96c78d816731 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:31.362524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01405ec-783b-42e6-a1cf-96c78d816731 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:31.364872 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 399/822] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:33:31.372821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:31.372821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:31.372821 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:31.395863 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:33:31.397913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:33:31.508846 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 424/823] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:33:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:33:31.893938 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01405ec-783b-42e6-a1cf-96c78d816731 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:32.028335 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01405ec-783b-42e6-a1cf-96c78d816731 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:32.071322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:32.072500 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:32.072769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:32.073074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:32.086465 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:32.088673 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:32.104694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:32.106093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:32.107273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:32.107273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:32.107273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:32.107273 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 400/824] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:32.112352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:32.244175 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c14b-2934-4201-b2d8-97723a56a9e5 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:32.281041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:32.293148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:32.293754 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:32.294030 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:32.294297 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:32.295076 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:32.295459 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:32.296937 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b6299-0918-44f1-96f7-b31f77e522cf None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:32.310008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 425/825] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:32.316324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:32.393056 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:32.450950 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2297368-db57-4ac1-85dd-6b31f0582a6e None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:32.489728 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bdef8-e4de-4d97-b12c-60287d10bdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:32.490622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bdef8-e4de-4d97-b12c-60287d10bdf3 None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:32.490899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bdef8-e4de-4d97-b12c-60287d10bdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:32.491169 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bdef8-e4de-4d97-b12c-60287d10bdf3 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:32.491817 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bdef8-e4de-4d97-b12c-60287d10bdf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:32.493281 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bdef8-e4de-4d97-b12c-60287d10bdf3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:32.514347 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 401/826] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 10 20:33:32 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:33:35.122921 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660fb96-8cd7-461d-8268-2c30eb21aaa2 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:35.123510 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660fb96-8cd7-461d-8268-2c30eb21aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:35.123609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660fb96-8cd7-461d-8268-2c30eb21aaa2 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:35.125275 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 426/827] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:33:35.131599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:35.132021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:35.132220 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:35.153486 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:33:35.154906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:33:35.225291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 402/828] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:33:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:33:35.578019 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660fb96-8cd7-461d-8268-2c30eb21aaa2 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:35.689432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660fb96-8cd7-461d-8268-2c30eb21aaa2 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:35.729281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:35.729916 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:35.730242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:35.730496 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:35.742467 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:33:35.748349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:35.750491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:35.751752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 427/829] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:33:35.755547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:35.803024 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:35.870704 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3882-7c0a-45c7-bb1c-38b94719ccef None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:35.907346 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:35.907947 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:35.908227 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:35.908497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:35.909206 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:35.909542 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:35.911090 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:35.920827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 403/830] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:35.926863 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:35.980483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:36.042028 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c91857-3d86-4cdb-ae20-d3047b631f17 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:36.078534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:36.079166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:36.079444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:36.079715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:36.090873 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:36.092352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:36.106818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:36.107815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:36.108690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:36.108690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:36.108690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:36.108690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 428/831] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:36.113719 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:36.223717 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:36.226937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19053-0fdd-4749-9e77-2515d178cb31 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:36.269247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:36.269857 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:36.270142 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:36.270418 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:36.271058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:36.271365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:36.272735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:36.285266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 404/832] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:36.291667 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:36.400589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:36.404831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3102c80-5ee7-4f0d-b7a5-077e031bf0a2 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:36.442666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:36.443289 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:36.443565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:36.443876 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:36.451323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:36.452742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:33:36.464246 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:36.465574 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:36.466742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 429/833] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:36.471534 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:36.580867 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d068b-8ce9-472c-8a37-ca9a011420e1 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:36.615977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:36.616581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:36.616900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:36.617180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:36.617897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:36.618812 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:36.620264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:36.638752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 405/834] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 10 20:33:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:36.644783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:36.760490 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ec4e-ef3e-4a57-a930-b1055f314a2b None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:36.798478 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:36.799148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:36.799430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:36.799729 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:36.830418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:36.879085 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:36.880463 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:36.991309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 430/835] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:33:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 10 20:33:36.997415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:37.017554 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:37.110479 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03718d-39c2-4cf3-a01d-87dd93adcce4 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:37.148695 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:37.149278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:37.150083 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:37.150569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:37.161265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:37.162818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:37.177211 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:37.178365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:37.179272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:37.179272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:37.179272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:37.179272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 406/836] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:37.184744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:37.251669 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:37.299876 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c865b24-954d-4d7a-bf19-1ab3092dec49 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:37.336753 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:37.337935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:37.338253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:37.338522 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:37.339146 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:37.340580 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:37.341982 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:37.354074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 431/837] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:37.359931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:37.440659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:37.477161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830046-aaea-46ea-8e26-19e0b3fa1af5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:37.510885 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:37.511497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:37.511776 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:37.512044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:37.519141 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:37.520740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:33:37.532861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:37.533930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:37.535020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 407/838] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:37.540413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:37.658511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdb25-b6f0-4a08-b7aa-d8c608856337 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:37.677986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:37.702865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:37.703546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:37.703898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:37.704333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:37.705670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:37.706124 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:37.708530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b59ba4-6be7-4539-b3f1-d380256036e3 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:37.724963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 432/839] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:33:37.732077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:37.843301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef83b5-b0e8-4b1b-97bd-e03a69a46d8d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:37.880915 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:37.890362 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39186-e727-481f-b855-7545928d0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:37.891013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39186-e727-481f-b855-7545928d0187 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:37.891319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39186-e727-481f-b855-7545928d0187 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:37.891612 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39186-e727-481f-b855-7545928d0187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:37.892371 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39186-e727-481f-b855-7545928d0187 None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=f16498f5c9ce4b8aa7192f492d387ea9) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:37.892780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39186-e727-481f-b855-7545928d0187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:37.894334 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39186-e727-481f-b855-7545928d0187 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:37.904665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 408/840] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:33:37 2022] GET /identity/v3/role_assignments?user.id=f16498f5c9ce4b8aa7192f492d387ea9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:33:40.474713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014039b-4235-4937-8d97-e6aca6a2b3f4 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:40.475272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014039b-4235-4937-8d97-e6aca6a2b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:40.475359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014039b-4235-4937-8d97-e6aca6a2b3f4 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:40.476758 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 433/841] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:33:40.482424 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ac743-0077-424b-b3bb-44501449d20f None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:40.482845 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ac743-0077-424b-b3bb-44501449d20f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:40.483010 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ac743-0077-424b-b3bb-44501449d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:40.501841 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-925ac743-0077-424b-b3bb-44501449d20f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:33:40.503048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-925ac743-0077-424b-b3bb-44501449d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:33:40.569823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 409/842] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:33:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:33:40.894666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014039b-4235-4937-8d97-e6aca6a2b3f4 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:41.011147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014039b-4235-4937-8d97-e6aca6a2b3f4 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:41.047737 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:41.048364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:41.048645 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:41.048964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:41.059502 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:33:41.064240 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:41.065683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:41.066506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 434/843] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:33:41.073184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ac743-0077-424b-b3bb-44501449d20f None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:41.180632 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ac743-0077-424b-b3bb-44501449d20f None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:41.207088 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:41.218002 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:41.218597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:41.218879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:41.219149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:41.219823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] RBAC: Adding query filter params (name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:41.220153 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:41.221553 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:41.229977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 410/844] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:41.236037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:41.278718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:41.341932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989411-e90a-49b9-ad91-1dfd366e5eb9 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:41.380701 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:41.381365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:41.381647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:41.381920 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:41.393074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:41.394516 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:41.412553 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:41.413790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:41.414697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:41.414697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:41.414697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:41.414697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 435/845] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:41.419562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:41.528655 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34c728-785f-4b41-9d9c-3c0d553606ad None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:41.567707 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:41.568417 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:41.568730 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:41.569120 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:41.569946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:41.570317 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:41.572105 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:41.585589 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 411/846] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:41.591998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:41.697339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:41.710069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a0eb6-a351-4887-81ae-385830ff819c None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:41.750565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:41.751253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:41.751602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:41.751897 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:41.760825 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:41.762483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:33:41.774698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:41.775898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:41.777049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 436/847] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:41.782135 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:41.837684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:41.884693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b02672-5fb9-4f61-a169-4ce58d42f757 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:41.920077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:41.920738 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:41.921022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:41.921351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:41.922063 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:41.922389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:41.923956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:41.943098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 412/848] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 10 20:33:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:41.949340 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:42.059823 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c197e5-1090-4f9a-90ab-f69dfa569f5a None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:42.094454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:42.095139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:42.095471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:42.095783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:42.107159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:42.108607 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:42.124180 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:42.125398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:42.126314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:42.126314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:42.126314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:42.126314 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 437/849] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:42.131359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:42.240723 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d4982-7255-48c3-bc19-8b5bbf0f8a88 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:42.243871 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:42.280468 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:42.281142 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:42.281466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:42.281711 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:42.282428 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:42.282822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:42.284490 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:42.296853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 413/850] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:42.305732 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:42.308955 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:42.419600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016e225-755b-43c9-bfc7-c07274de4ddf None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:42.455418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:42.456037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:42.456316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:42.456587 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:42.463203 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:42.464640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:33:42.475835 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:42.477130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:42.478600 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 438/851] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:42.483581 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:42.592212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a06d-828b-43e4-9795-467f3b501a37 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:42.627709 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:42.628453 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:42.628739 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:42.629058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:42.629875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:42.630265 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:42.631986 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560b63c-fb76-45a7-b204-1dbde9276624 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:42.645457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 414/852] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:42.651953 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:42.726758 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:42.769951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20a9c2-a0c1-4e59-bd5f-5941534808f0 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:42.807944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97ebcd-bf4d-4800-bc84-1415439f5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:42.808731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97ebcd-bf4d-4800-bc84-1415439f5c8d None admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:42.809003 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97ebcd-bf4d-4800-bc84-1415439f5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:42.809355 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97ebcd-bf4d-4800-bc84-1415439f5c8d None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/f16498f5c9ce4b8aa7192f492d387ea9/roles/41ac2fa59279401c8f73e54f82a77b7d` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:42.826910 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97ebcd-bf4d-4800-bc84-1415439f5c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=f16498f5c9ce4b8aa7192f492d387ea9, role_id=41ac2fa59279401c8f73e54f82a77b7d)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:42.828501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97ebcd-bf4d-4800-bc84-1415439f5c8d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:42.841759 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 439/853] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:33:42 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/f16498f5c9ce4b8aa7192f492d387ea9/roles/41ac2fa59279401c8f73e54f82a77b7d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:33:45.464727 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5671c-9b5a-422f-81c1-e61df3861032 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:45.465381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5671c-9b5a-422f-81c1-e61df3861032 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:45.465381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5671c-9b5a-422f-81c1-e61df3861032 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:45.466632 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 415/854] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:33:45.472465 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:45.472994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:45.473083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:45.493686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:33:45.494901 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:33:45.567639 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 440/855] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:33:45 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:33:45.916897 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5671c-9b5a-422f-81c1-e61df3861032 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:45.942936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:46.030683 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5671c-9b5a-422f-81c1-e61df3861032 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:46.067386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:46.068016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:46.068289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:46.068559 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:46.079019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:33:46.083765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:46.088991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:46.090124 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 416/856] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 10 20:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:46.091885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:46.138816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:46.199110 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e448c-6b58-477f-9823-6be0145027a1 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:46.234858 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:46.235473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:46.235748 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:46.236018 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:46.236676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] RBAC: Adding query filter params (name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:46.237008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:46.238384 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:46.247219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 441/857] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 10 20:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:46.253126 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:46.349553 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:46.370940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac915209-27b1-4a0f-8cdc-233152fc979a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:46.406272 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:46.406863 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:46.407136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:46.407403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:46.419066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:46.420667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:46.438067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:46.439286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:46.440842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:46.440842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:46.440842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:46.440842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 417/858] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:46.445579 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:46.558333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1edb-6271-4751-bfbc-3591a860aa68 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:46.560784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:46.601073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:46.601698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:46.602105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:46.602498 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:46.603134 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:46.603437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:46.604828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:46.619589 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 442/859] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:46.625823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:46.759650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bb4dd-d39c-4e40-a49c-c9881ffdd3d9 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:46.803498 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:46.804023 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:46.804301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:46.804574 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:46.807915 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:46.813459 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:46.815186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:33:46.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:46.829031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:46.830040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 418/860] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:46.835184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:46.942216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85c87-ef51-42c0-982d-960679a1fdd5 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:46.978971 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:46.980111 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:46.980391 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:46.981078 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:46.981798 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:46.982095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:46.983533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:47.001588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 443/861] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 10 20:33:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:47.007606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:47.124782 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b8e5b-762e-425f-8298-05a81e05a65a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:47.163930 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:47.165122 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:47.165422 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:47.165768 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:47.237841 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:47.246842 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:47.248612 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:47.365481 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 419/862] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:33:47 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 10 20:33:47.372845 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:47.406390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:47.494614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df1a54-5ca4-4bb5-8aa3-72f4d067cce4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:47.533279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:47.533900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:47.534176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:47.534443 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:47.544950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:47.546433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:47.561999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:47.565191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:47.566281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:47.566281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:47.566281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:47.566281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 444/863] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:33:47.569543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:47.672854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:47.681564 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f230af-7906-41dd-857c-4582b98fd65b None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:47.720900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:47.722829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:47.723297 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:47.723878 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:47.724666 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:47.725145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:47.727162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:47.746908 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 420/864] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:47.748369 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:47.825129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:47.853055 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc0cf-8def-4521-8a3c-67220456cf62 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:47.890049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:47.890669 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:47.890950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:47.891224 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:47.899238 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:47.900665 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:33:47.912035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:47.913339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:47.915054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:47.918393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 445/865] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:33:47.919521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:48.030569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5007-f276-442f-b14e-edea585d22f3 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:48.065092 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:48.065689 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:48.065967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:48.066236 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:48.066913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:48.067222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:48.068669 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0dffd-ff20-4c02-b67d-523a6af801ac None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:48.082429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 421/866] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:48.092505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:48.196641 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4da71c-6a5f-40e6-aa74-a3ee27a1d6f8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:48.231077 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:48.231675 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:48.231950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:48.232225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:48.233126 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] RBAC: Adding query filter params (role.id=41ac2fa59279401c8f73e54f82a77b7d, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=f16498f5c9ce4b8aa7192f492d387ea9) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:48.233390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:48.234850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663436f-ade4-48e2-9fc0-24401003279b None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:48.236616 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:48.242049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 446/867] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:33:48 2022] GET /identity/v3/role_assignments?user.id=f16498f5c9ce4b8aa7192f492d387ea9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=41ac2fa59279401c8f73e54f82a77b7d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:33:50.767895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5d7d-c0ad-415e-a17c-382fe1356c3a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:50.768451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5d7d-c0ad-415e-a17c-382fe1356c3a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:50.768451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5d7d-c0ad-415e-a17c-382fe1356c3a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:50.769809 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 422/868] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:33:50.775081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:50.775493 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:50.775615 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:50.793169 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:33:50.794338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:33:50.858914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 447/869] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:33:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:33:51.181522 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5d7d-c0ad-415e-a17c-382fe1356c3a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:51.199892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:51.280067 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5d7d-c0ad-415e-a17c-382fe1356c3a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:51.312169 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:51.312766 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:51.313137 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:51.313401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:51.323814 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:33:51.328497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:51.329606 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:51.330617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 423/870] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 10 20:33:51.335422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:51.428631 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e294-cd62-46dd-bcfe-4e6f2712e4e3 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:51.457211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:51.465481 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:51.466082 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:51.466358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:51.466624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:51.467274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:51.467571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:51.468963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:51.477284 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 448/871] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:51.483228 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:51.558958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:51.582640 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87da8-2ade-4ede-a5f4-9bcb7c76f690 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:51.615571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:51.616180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:51.616460 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:51.616733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:51.626945 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:51.628379 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:51.642573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:51.643523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:51.644483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:51.644483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:51.644483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:51.644483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 424/872] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:51.649408 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:51.769487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c923a2e-5c99-4471-a2b8-83e78865eede None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:51.801797 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:51.802430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:51.802648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:51.802915 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:51.803537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:51.803834 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:51.805849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:51.817231 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 449/873] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:51.823030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:51.919311 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144e17d-71c9-4acc-9048-6f67dc59da82 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:51.944569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:51.952570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:51.953202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:51.953483 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:51.953753 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:51.960918 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:51.962868 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:33:51.973598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:51.974681 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:51.975929 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 425/874] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:51.980949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:52.029929 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:52.082902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003fce-63dd-42a1-baad-6a6c512e7af4 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:52.115621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:52.116203 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:52.116480 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:52.116746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:52.117507 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:52.117805 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:52.119216 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:52.136165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 450/875] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 10 20:33:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:52.142007 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:52.238279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ca6c-ae99-45bf-9899-1e7817af5660 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:52.271076 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:52.271676 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:52.271952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:52.272220 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:52.328941 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:52.344011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:52.345535 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:52.444457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 426/876] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:33:52 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 10 20:33:52.450708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:52.547608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e89e-6cda-4faa-a293-932438fd6306 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:52.556300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:52.581131 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:52.581696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:52.581976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:52.582248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:52.592543 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:52.594024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:52.607999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:52.609093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:52.610187 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:52.610187 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:52.610187 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:52.610187 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 451/877] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:52.614798 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:52.703773 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:52.717091 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeff95a-187d-4b70-b0ef-13204a863616 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:52.751519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:52.752110 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:52.752383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:52.752650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:52.753314 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:52.753613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:52.754958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:52.766295 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 427/878] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:52.771952 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:52.868702 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef40c3-675d-4068-afda-76c68321e19d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:52.900285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:52.900923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:52.901202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:52.901496 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:52.907784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:52.909245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:33:52.919960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:52.920996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:33:52.921902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 452/879] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:52.926772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:53.026076 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc43434-a209-4f29-9a9e-fc0eef205d58 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:53.058936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:53.059533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:53.059816 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:53.060090 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:53.060774 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:53.061115 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:53.062539 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014ec19-ba36-4698-b8cb-3b81f57212ac None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:53.075020 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 428/880] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:53.081101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:53.106305 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:53.182350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1a2a-3d6e-4fea-af75-b93af82670d0 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:53.214939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:53.215578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:53.215859 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:53.216133 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:53.216867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=f16498f5c9ce4b8aa7192f492d387ea9) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:53.217174 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:53.218583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa60d8-c676-471e-a80d-923bf5708e62 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:53.223716 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 453/881] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:33:53 2022] GET /identity/v3/role_assignments?user.id=f16498f5c9ce4b8aa7192f492d387ea9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:55.590840 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8feb4-4643-4ff0-b790-25dc8727b37a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:55.591395 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8feb4-4643-4ff0-b790-25dc8727b37a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:55.591395 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8feb4-4643-4ff0-b790-25dc8727b37a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:55.592725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 429/882] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:33:55.597723 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:55.598134 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:55.598269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:55.615816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:33:55.617035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:33:55.682349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 454/883] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:33:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:33:56.014033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8feb4-4643-4ff0-b790-25dc8727b37a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:56.024893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:56.117104 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8feb4-4643-4ff0-b790-25dc8727b37a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:56.158118 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:56.158854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:56.159147 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:56.159560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:56.170484 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:33:56.175174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:56.176288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:56.177524 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 430/884] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:56.182830 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:56.198467 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:56.276532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ec1c8-e243-4702-9ffd-9fd2390cc5b7 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:56.308377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:56.308989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:56.309265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:56.309530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:56.310166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:56.310460 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:56.311831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:56.319606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 455/885] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:56.325736 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:56.390199 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:56.421884 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eade4c-636b-48d0-be13-158171b4207d None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:56.457761 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:56.458382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:56.458663 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:56.458937 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:56.469103 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:56.470535 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:56.485896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:56.486968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:56.487875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:56.487875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:56.487875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:56.487875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 431/886] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:56.492777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:56.565912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:56.587686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a115-26a9-4ab0-90e0-9c3c42c9b2f8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:56.619535 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:56.620100 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:56.620378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:56.620647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:56.621299 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:56.621594 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:56.622933 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:56.634048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 456/887] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:56.639690 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:56.740388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781deb-edce-4383-af90-6ebc0ca8a9ec None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:56.759100 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:56.773121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:56.774274 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:56.774552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:56.774826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:56.781982 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:56.783404 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:33:56.794856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:56.795928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:56.797140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 432/888] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:56.801839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:56.896546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742c36-4fc3-42ee-8b19-c07828d1e8ef None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:56.929200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:56.929778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:56.930051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:56.930318 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:56.931012 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:56.931308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:56.932711 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:56.935084 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:56.949645 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 457/889] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:56.955257 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:57.052111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b8c8-8d5f-463e-a8a9-763a9631b545 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:57.084926 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:57.085537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:57.085818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:57.086115 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:57.096750 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:57.098216 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:33:57.111880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:57.112989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:33:57.113900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:33:57.113900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:33:57.113900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:57.113900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 433/890] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:57.118650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:57.212406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675467-264e-4a61-b541-2d510e663400 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:57.245305 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:57.245885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:57.246159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:57.246422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:57.247031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:57.247324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:57.248673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:57.259232 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 458/891] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:33:57.264974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:57.296529 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:57.363312 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c269abd-1d9e-439d-ac21-187e3ee0bc8f None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:57.395121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:57.395730 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:57.396012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:57.396288 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:57.403238 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:57.404670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:33:57.416235 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:33:57.417269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:33:57.418336 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 434/892] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:33:57.423060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:57.478544 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:57.521992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9c43-e6f8-4c5c-bbba-adcbf58703b8 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:57.555689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:57.556377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:57.556661 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:57.556969 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:57.557650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:33:57.557955 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:57.559374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b0593-a756-4b3d-982f-c7774ebd803f None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:57.571546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 459/893] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:33:57.577556 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:33:57.666160 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:33:57.676627 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16c00-41f3-4fa3-94ad-685b371b9cd5 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:33:57.714188 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b767-fa01-41c7-b91e-21b6f155a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:33:57.714827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b767-fa01-41c7-b91e-21b6f155a629 None admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:33:57.715108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b767-fa01-41c7-b91e-21b6f155a629 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:33:57.715383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b767-fa01-41c7-b91e-21b6f155a629 None admin] PATH_INFO: `/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/f16498f5c9ce4b8aa7192f492d387ea9/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:33:57.717282 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093b767-fa01-41c7-b91e-21b6f155a629 None admin] RBAC: Authorizing `identity:create_grant(project_id=890e5386cd904d8abe3df34e12e047f8, user_id=f16498f5c9ce4b8aa7192f492d387ea9, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:33:57.718713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093b767-fa01-41c7-b91e-21b6f155a629 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:33:57.730696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 435/894] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 10 20:33:57 2022] PUT /identity/v3/projects/890e5386cd904d8abe3df34e12e047f8/users/f16498f5c9ce4b8aa7192f492d387ea9/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:34:00.083477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642903-f181-4dda-9124-0ce9d84765b3 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:00.083981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642903-f181-4dda-9124-0ce9d84765b3 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:00.083981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642903-f181-4dda-9124-0ce9d84765b3 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:00.085374 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 460/895] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:34:00.090415 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:00.090856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:00.090949 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:00.109891 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:34:00.111072 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:34:00.176745 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 436/896] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:34:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:34:00.495935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47642903-f181-4dda-9124-0ce9d84765b3 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:00.593117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47642903-f181-4dda-9124-0ce9d84765b3 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:00.606102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:00.624747 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:00.625451 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:00.625724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:00.625990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:00.636009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 10 20:34:00.640697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:00.641777 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:00.642995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 461/897] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 10 20:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:00.647725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:00.731274 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:00.752693 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5be4a1-6cbc-4724-a500-51b7ebca0f4e None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:00.785944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:00.786519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:00.786797 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:00.787068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:00.787713 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:00.788014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:00.789423 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:00.797137 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 437/898] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 10 20:34:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:00.803110 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:00.897849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00244ce-8cc4-44ed-8494-daf01177a052 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:00.931652 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:00.932266 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:00.932547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:00.932847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:00.942652 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:00.944086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:34:00.958159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:00.959262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:34:00.960194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:34:00.960194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:34:00.960194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:00.960194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 462/899] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:00.965884 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:01.064139 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03f67-e2b5-425d-807f-9ec74364d1d7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:01.097022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:01.097599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:01.097880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:01.098151 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:01.098779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:01.099080 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:01.100443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:01.112299 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 438/900] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:01.118612 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:01.145701 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:01.217361 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c74bd-7546-4378-b098-6dde7da49421 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:01.249335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:01.249942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:01.250219 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:01.250491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:01.258779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:01.260196 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 10 20:34:01.270806 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:01.271880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:01.273285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 463/901] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:34:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:01.277771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:01.281535 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:01.374613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0b20-234e-4bc6-96e1-1e31f4cbe882 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:01.406567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:01.407152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:01.407429 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:01.407698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:01.408397 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:01.408698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:01.410137 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:01.426774 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 439/902] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 10 20:34:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:01.433189 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:01.513746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:01.527915 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5089-d6ab-4a26-ae5e-77352f7eb4e6 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:01.560833 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:01.561434 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:01.561712 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:01.561979 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:01.625501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:01.626867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:01.703911 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:01.719675 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 464/903] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 10 20:34:01 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 10 20:34:01.725464 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:01.783668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:01.820742 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193a29-1657-485c-aaac-1d340ced8d3c None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:01.854128 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:01.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:01.855012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:01.855282 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:01.864764 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:01.866206 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 10 20:34:01.880853 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:01.882016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 10 20:34:01.883278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 10 20:34:01.883278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 10 20:34:01.883278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:34:01.883278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 440/904] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:01.887603 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:01.982713 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645a08-aedb-4db0-9db7-1b8871f99775 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:02.014345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:02.014932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:02.015204 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:02.015469 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:02.016087 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:02.016380 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:02.017744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:02.028698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 465/905] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 10 20:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:02.034236 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:02.129568 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353694d-e15b-4390-979a-7c29249a3f9a None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:02.142974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:02.163188 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:02.163806 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:02.164087 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:02.164360 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:02.170904 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:02.172330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 10 20:34:02.183250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:02.184261 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: ERROR keystone.server.flask.application Sep 10 20:34:02.185196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 441/906] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 10 20:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:02.190387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:02.240734 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:02.292155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f76ab-4da4-470f-a0e4-162c0a41a783 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:02.324368 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:02.324989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:02.325274 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:02.325550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:02.326247 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:02.326539 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:02.327956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e0b8-b4a2-468a-b3aa-be323ab7823f None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:02.339368 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 466/907] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 10 20:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:02.345451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:02.442812 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b1f9-6764-4717-bb28-8480612793c7 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:02.474924 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:02.475503 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:02.475783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:02.476055 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:02.476783 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] RBAC: Adding query filter params (role.id=ad5067901a144373a35aac9ba7bf4722, scope.project.id=890e5386cd904d8abe3df34e12e047f8, user.id=f16498f5c9ce4b8aa7192f492d387ea9) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:02.477117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:02.478538 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33afe3-53dd-49e8-81b0-89fa0248fb2c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:02.484224 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 442/908] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 10 20:34:02 2022] GET /identity/v3/role_assignments?user.id=f16498f5c9ce4b8aa7192f492d387ea9&scope.project.id=890e5386cd904d8abe3df34e12e047f8&role.id=ad5067901a144373a35aac9ba7bf4722 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:04.896036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859634-6a02-4041-8e5c-7b4f3e5a8d0b None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:04.896611 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859634-6a02-4041-8e5c-7b4f3e5a8d0b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:04.896611 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859634-6a02-4041-8e5c-7b4f3e5a8d0b None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:04.897932 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 467/909] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:34:04.903659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:04.904088 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:04.904190 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:04.922355 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:34:04.923521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:34:04.952140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:04.990195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 443/910] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:34:04 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:34:05.313101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859634-6a02-4041-8e5c-7b4f3e5a8d0b None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:05.409473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859634-6a02-4041-8e5c-7b4f3e5a8d0b None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:05.417628 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:05.443559 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:05.444167 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:05.444441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:05.444709 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:05.445305 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:05.446676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:05.455083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:05.456271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:05.457237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 468/911] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 10 20:34:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:05.462556 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:05.556108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba8535-fdcf-47b3-a00b-bd73cadfb5a3 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:05.590113 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:05.590712 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:05.590991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:05.591263 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:05.591878 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:05.592180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:05.593568 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439abb2-60b5-4c8e-b74a-1ef084e85988 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:05.598106 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 444/912] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 10 20:34:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:05.604471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:05.701280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d33a7b-c059-4ff8-b784-5ea9c6f60d38 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:05.735008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:05.735939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:05.736214 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:05.736655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] PATH_INFO: `/v3/services` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:05.737546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:05.737911 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:05.739770 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876579d-eb0f-468f-b8fc-2ddaa66784e7 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:05.745643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 469/913] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 10 20:34:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:08.086731 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87e5d-f6fc-4f67-a269-ea1fbb82fc5a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:08.087271 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87e5d-f6fc-4f67-a269-ea1fbb82fc5a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:08.087271 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87e5d-f6fc-4f67-a269-ea1fbb82fc5a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:08.088594 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 445/914] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:34:08.093813 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30160427-d227-4610-b02f-729d62e36fcf None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:08.094227 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30160427-d227-4610-b02f-729d62e36fcf None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:08.094371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30160427-d227-4610-b02f-729d62e36fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:08.112537 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-30160427-d227-4610-b02f-729d62e36fcf None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:34:08.114512 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-30160427-d227-4610-b02f-729d62e36fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:34:08.140051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:08.183052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 470/915] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:34:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:34:08.505410 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87e5d-f6fc-4f67-a269-ea1fbb82fc5a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:08.543075 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:08.611775 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87e5d-f6fc-4f67-a269-ea1fbb82fc5a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:08.644484 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044863b9-9b8b-4296-a8f2-88b081b0fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:08.645092 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044863b9-9b8b-4296-a8f2-88b081b0fb1c None admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:08.645370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044863b9-9b8b-4296-a8f2-88b081b0fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:08.645640 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044863b9-9b8b-4296-a8f2-88b081b0fb1c None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:08.646276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044863b9-9b8b-4296-a8f2-88b081b0fb1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:08.647626 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044863b9-9b8b-4296-a8f2-88b081b0fb1c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:08.661572 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 446/916] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 10 20:34:08 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:34:11.071376 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766ae4-9da3-44c1-8b9f-87631e6cb74c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:11.071908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766ae4-9da3-44c1-8b9f-87631e6cb74c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:11.071908 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766ae4-9da3-44c1-8b9f-87631e6cb74c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:11.073262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 471/917] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:34:11.078399 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:11.078789 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:11.078952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:11.097948 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:34:11.099133 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:34:11.171655 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 447/918] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:34:11 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:34:11.490949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0766ae4-9da3-44c1-8b9f-87631e6cb74c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:11.597339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0766ae4-9da3-44c1-8b9f-87631e6cb74c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:11.634347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:11.634954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:11.635234 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:11.635508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:11.636074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:11.637463 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:11.645938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:11.646943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:11.647838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 472/919] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 10 20:34:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:11.653000 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:11.670424 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:11.747905 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68069c42-cfe0-4e32-8ac3-2c0ecf16da91 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:11.779989 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:11.780573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:11.780880 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:11.781149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:11.781753 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:11.782048 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:11.783395 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:11.788149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 448/920] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 10 20:34:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:11.794029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:11.822643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:11.902721 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b81bd-6bf6-4bf7-aff7-7071c04e535d None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:11.935326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:11.935919 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:11.936199 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:11.936473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:11.937189 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] RBAC: Adding query filter params (interface=public, service_id=ead125f59b7f45a4a4550e1d1fcd9cae, region_id=RegionOne) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:11.937496 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:11.938856 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3818a-fbcc-45bb-ba88-fdd5fef685e4 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:11.943881 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 473/921] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 10 20:34:11 2022] GET /identity/v3/endpoints?service_id=ead125f59b7f45a4a4550e1d1fcd9cae&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:11.949909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:12.027563 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:12.045608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d996ae-265e-4622-82da-5034be3c9ac2 None admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:12.078516 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a671-8c59-49f3-aeb6-751488920b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:12.079089 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a671-8c59-49f3-aeb6-751488920b72 None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:12.079367 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a671-8c59-49f3-aeb6-751488920b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:12.079641 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a671-8c59-49f3-aeb6-751488920b72 None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:12.080228 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a671-8c59-49f3-aeb6-751488920b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:12.081607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a671-8c59-49f3-aeb6-751488920b72 None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:12.087837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 449/922] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 10 20:34:11 2022] GET /identity/v3/services => generated 1962 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:34:14.440071 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5f71-f52d-4b66-af2a-a8ae956d0ad8 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:14.440869 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5f71-f52d-4b66-af2a-a8ae956d0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:14.440982 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5f71-f52d-4b66-af2a-a8ae956d0ad8 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:14.442224 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 474/923] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:34:14.447411 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:14.447827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:14.447952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:14.466044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:34:14.467220 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:34:14.531642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 450/924] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:34:14 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 10 20:34:14.850236 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5f71-f52d-4b66-af2a-a8ae956d0ad8 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:14.939096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:14.949522 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5f71-f52d-4b66-af2a-a8ae956d0ad8 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:14.981933 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:14.982560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:14.982839 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:14.983113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:14.983683 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:14.985129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 10 20:34:14.994000 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 10 20:34:14.995127 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.get_or_create( Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application with Lock( Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self._enter() Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application return self.creator() Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application created_value = creator( Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: ERROR keystone.server.flask.application Sep 10 20:34:14.996148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 475/925] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 10 20:34:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 10 20:34:15.001140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:15.076601 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:15.099587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926be2-57c5-4d24-aa86-0bc5abe115d5 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:15.131722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:15.132257 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:15.132537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:15.133365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] PATH_INFO: `/v3/services` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:15.133987 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:34:15.134289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:15.135669 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c225ec-cc21-4a20-a690-f885debecc3c None admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:15.140552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 451/926] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 10 20:34:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:34:15.146288 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:34:15.244281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e1a5-e02d-4efd-bbd9-cf83bf7d4d09 None admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:34:15.276771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1492001-bf21-4089-acd0-d1829c2c2438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:34:15.277390 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492001-bf21-4089-acd0-d1829c2c2438 None admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:34:15.277667 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492001-bf21-4089-acd0-d1829c2c2438 None admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:34:15.277934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1492001-bf21-4089-acd0-d1829c2c2438 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:34:15.278595 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1492001-bf21-4089-acd0-d1829c2c2438 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:34:15.279943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1492001-bf21-4089-acd0-d1829c2c2438 None admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:34:15.298644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 476/927] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:34:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:34:25.138844 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=30 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:34:25.294593 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:35:15.056569 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe6f8-e2d0-423d-95fc-b8322d361333 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:15.057177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe6f8-e2d0-423d-95fc-b8322d361333 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:15.057177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe6f8-e2d0-423d-95fc-b8322d361333 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:15.060217 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 452/928] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:15.067034 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc717d-0505-47c7-a1c7-72966b6dac63 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:15.067583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc717d-0505-47c7-a1c7-72966b6dac63 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:15.067800 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc717d-0505-47c7-a1c7-72966b6dac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:15.090115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-69fc717d-0505-47c7-a1c7-72966b6dac63 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:15.091647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-69fc717d-0505-47c7-a1c7-72966b6dac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:15.206249 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 477/929] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:15.559329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965075-30af-4f2f-82d0-d19f66920dd6 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:15.559621 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965075-30af-4f2f-82d0-d19f66920dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:15.559944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965075-30af-4f2f-82d0-d19f66920dd6 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:15.561386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 453/930] 10.222.0.16 () {54 vars in 965 bytes} [Sat Sep 10 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:15.568083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198ed6-e6a2-4339-8aa4-d49246528f23 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:15.568375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198ed6-e6a2-4339-8aa4-d49246528f23 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:15.568656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198ed6-e6a2-4339-8aa4-d49246528f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:15.631040 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-f5198ed6-e6a2-4339-8aa4-d49246528f23 None None] MFA Rules not processed for user `1ae5691b5c9e45be9a585d5db0ab5cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:15.632269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-f5198ed6-e6a2-4339-8aa4-d49246528f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:15.692334 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 478/931] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Sep 10 20:35:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:35:15.702624 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965075-30af-4f2f-82d0-d19f66920dd6 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:15.714854 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965075-30af-4f2f-82d0-d19f66920dd6 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:15.718319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b20570-7243-4284-96e6-df3113edec73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:15.718909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b20570-7243-4284-96e6-df3113edec73 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:15.719184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b20570-7243-4284-96e6-df3113edec73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:15.719451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b20570-7243-4284-96e6-df3113edec73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:15.729695 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b20570-7243-4284-96e6-df3113edec73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:15.731157 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b20570-7243-4284-96e6-df3113edec73 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:15.743167 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 454/932] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:18.403200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51bcef-6741-4a3b-9292-9bd5d5569fcc None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:18.403743 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51bcef-6741-4a3b-9292-9bd5d5569fcc None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:18.403743 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51bcef-6741-4a3b-9292-9bd5d5569fcc None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:18.407687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 479/933] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:18.410654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fe392-06fa-47a0-a8be-69cc148341fb None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:18.411125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fe392-06fa-47a0-a8be-69cc148341fb None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:18.411202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fe392-06fa-47a0-a8be-69cc148341fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:18.433906 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-769fe392-06fa-47a0-a8be-69cc148341fb None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:18.435577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-769fe392-06fa-47a0-a8be-69cc148341fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:18.445590 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 455/934] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:18.824116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc886-071f-47f1-b8d6-fe9527c3a825 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:18.824461 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc886-071f-47f1-b8d6-fe9527c3a825 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:18.824671 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc886-071f-47f1-b8d6-fe9527c3a825 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:18.826317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 480/935] 10.222.0.16 () {54 vars in 965 bytes} [Sat Sep 10 20:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:18.833676 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004184d-365e-4d8c-bbb7-31c297597a06 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:18.834105 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004184d-365e-4d8c-bbb7-31c297597a06 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:18.834493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004184d-365e-4d8c-bbb7-31c297597a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:18.855992 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-9004184d-365e-4d8c-bbb7-31c297597a06 None None] MFA Rules not processed for user `1ae5691b5c9e45be9a585d5db0ab5cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:18.857437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9004184d-365e-4d8c-bbb7-31c297597a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:18.864189 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 456/936] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Sep 10 20:35:18 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:18.873237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dc886-071f-47f1-b8d6-fe9527c3a825 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:18.884188 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dc886-071f-47f1-b8d6-fe9527c3a825 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:18.887701 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2398d7-74d5-4a5d-9664-bbe33a03e01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:18.888285 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2398d7-74d5-4a5d-9664-bbe33a03e01c service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:18.888566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2398d7-74d5-4a5d-9664-bbe33a03e01c service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:18.888875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2398d7-74d5-4a5d-9664-bbe33a03e01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:18.898255 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2398d7-74d5-4a5d-9664-bbe33a03e01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:18.899687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2398d7-74d5-4a5d-9664-bbe33a03e01c service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:18.909176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 481/937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:21.870003 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837e89-27dc-4dd4-9f6e-9cc3eb022a1e None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:21.870609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837e89-27dc-4dd4-9f6e-9cc3eb022a1e None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:21.870609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af837e89-27dc-4dd4-9f6e-9cc3eb022a1e None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:21.871900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 457/938] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:21.876976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a9fd0-a7d8-48fd-b3f1-b1e06564d8e1 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:21.877360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a9fd0-a7d8-48fd-b3f1-b1e06564d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:21.877522 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a9fd0-a7d8-48fd-b3f1-b1e06564d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:21.914294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-018a9fd0-a7d8-48fd-b3f1-b1e06564d8e1 None None] MFA Rules not processed for user `95ed238335d547508b979f5f80415d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:21.915494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-018a9fd0-a7d8-48fd-b3f1-b1e06564d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:21.957157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:35:21.990562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 482/939] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:21 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:22.331735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af837e89-27dc-4dd4-9f6e-9cc3eb022a1e None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:22.342650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af837e89-27dc-4dd4-9f6e-9cc3eb022a1e None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:22.346011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6afbf-03d1-4428-9301-d279bfe8465c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:22.346587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6afbf-03d1-4428-9301-d279bfe8465c service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:22.346861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6afbf-03d1-4428-9301-d279bfe8465c service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:22.347128 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6afbf-03d1-4428-9301-d279bfe8465c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:22.356031 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6afbf-03d1-4428-9301-d279bfe8465c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:22.357478 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6afbf-03d1-4428-9301-d279bfe8465c service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:22.366538 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 458/940] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:22 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:25.463895 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5e7c-8214-4837-b6d5-8aafe75fd6e4 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:25.464426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5e7c-8214-4837-b6d5-8aafe75fd6e4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:25.464426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5e7c-8214-4837-b6d5-8aafe75fd6e4 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:25.465802 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 483/941] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:25.471371 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbd2f-7269-4f90-8e12-67265de966b7 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:25.471823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbd2f-7269-4f90-8e12-67265de966b7 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:25.471928 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbd2f-7269-4f90-8e12-67265de966b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:25.492448 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-35dfbd2f-7269-4f90-8e12-67265de966b7 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:25.493668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-35dfbd2f-7269-4f90-8e12-67265de966b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:25.560665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 459/942] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:25 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:25.902937 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a5e7c-8214-4837-b6d5-8aafe75fd6e4 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:25.913279 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a5e7c-8214-4837-b6d5-8aafe75fd6e4 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:25.916679 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05919235-d9d8-4166-b61b-4c0c6733447c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:25.917298 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05919235-d9d8-4166-b61b-4c0c6733447c service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:25.917578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05919235-d9d8-4166-b61b-4c0c6733447c service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:25.917857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05919235-d9d8-4166-b61b-4c0c6733447c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:25.926404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05919235-d9d8-4166-b61b-4c0c6733447c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:25.927817 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05919235-d9d8-4166-b61b-4c0c6733447c service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:25.937542 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 484/943] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:25 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:28.966423 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b1eb6-542d-4e77-83c0-883945f2f09d None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:28.966957 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b1eb6-542d-4e77-83c0-883945f2f09d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:28.966957 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b1eb6-542d-4e77-83c0-883945f2f09d None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:28.968289 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 460/944] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:28.973656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f80418-03a3-4bee-99c8-cf54673b9869 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:28.974074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f80418-03a3-4bee-99c8-cf54673b9869 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:28.974312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f80418-03a3-4bee-99c8-cf54673b9869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:28.994100 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-31f80418-03a3-4bee-99c8-cf54673b9869 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:28.995281 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-31f80418-03a3-4bee-99c8-cf54673b9869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:29.002797 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 485/945] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:29.340576 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b1eb6-542d-4e77-83c0-883945f2f09d None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:29.351018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b1eb6-542d-4e77-83c0-883945f2f09d None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:29.354465 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879903d-fe81-4ae9-b681-ba4d54ac63c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:29.355032 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879903d-fe81-4ae9-b681-ba4d54ac63c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:29.355303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879903d-fe81-4ae9-b681-ba4d54ac63c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:29.355567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879903d-fe81-4ae9-b681-ba4d54ac63c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:29.364414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879903d-fe81-4ae9-b681-ba4d54ac63c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:29.365899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879903d-fe81-4ae9-b681-ba4d54ac63c9 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:29.375113 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 461/946] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:31.925779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640721d-2194-40ac-8201-23dd047a2cc0 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:31.926333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640721d-2194-40ac-8201-23dd047a2cc0 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:31.926333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640721d-2194-40ac-8201-23dd047a2cc0 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:31.927635 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 486/947] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:31.933324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5e86-1342-423c-bff2-28eda9af8eca None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:31.933743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5e86-1342-423c-bff2-28eda9af8eca None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:31.933874 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5e86-1342-423c-bff2-28eda9af8eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:31.954001 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-06be5e86-1342-423c-bff2-28eda9af8eca None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:31.955201 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-06be5e86-1342-423c-bff2-28eda9af8eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:31.963219 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 462/948] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:32.293530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640721d-2194-40ac-8201-23dd047a2cc0 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:32.304622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640721d-2194-40ac-8201-23dd047a2cc0 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:32.308016 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d8208-8324-4d8f-bdba-6cb911b70fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:32.308595 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d8208-8324-4d8f-bdba-6cb911b70fcf service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:32.308899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d8208-8324-4d8f-bdba-6cb911b70fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:32.309195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d8208-8324-4d8f-bdba-6cb911b70fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:32.317885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d8208-8324-4d8f-bdba-6cb911b70fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:32.319317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d8208-8324-4d8f-bdba-6cb911b70fcf service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:32.328447 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 487/949] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:34.781926 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269a376-da88-4ad1-937f-deaf6c3edabf None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:34.782457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269a376-da88-4ad1-937f-deaf6c3edabf None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:34.782457 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269a376-da88-4ad1-937f-deaf6c3edabf None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:34.783812 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 463/950] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:34.789057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ed18-1cfd-44db-b2a3-c4c1eb6c72d2 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:34.789441 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ed18-1cfd-44db-b2a3-c4c1eb6c72d2 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:34.789597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ed18-1cfd-44db-b2a3-c4c1eb6c72d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:34.810433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-bec3ed18-1cfd-44db-b2a3-c4c1eb6c72d2 None None] MFA Rules not processed for user `95ed238335d547508b979f5f80415d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:34.811618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-bec3ed18-1cfd-44db-b2a3-c4c1eb6c72d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:34.819609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 488/951] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:34 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:35.163645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269a376-da88-4ad1-937f-deaf6c3edabf None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:35.180256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269a376-da88-4ad1-937f-deaf6c3edabf None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:35.186086 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391ac42-533f-4ef5-8103-16baf4a8e89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:35.187013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391ac42-533f-4ef5-8103-16baf4a8e89e service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:35.187489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391ac42-533f-4ef5-8103-16baf4a8e89e service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:35.187939 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391ac42-533f-4ef5-8103-16baf4a8e89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:35.202879 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391ac42-533f-4ef5-8103-16baf4a8e89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:35.205475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391ac42-533f-4ef5-8103-16baf4a8e89e service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:35.221779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 464/952] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:35 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:37.870456 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2205-7afb-48d4-97d7-a9171c0d0866 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:37.870951 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2205-7afb-48d4-97d7-a9171c0d0866 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:37.871047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f2205-7afb-48d4-97d7-a9171c0d0866 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:37.872321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 489/953] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:35:37.877514 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0addee-632e-42bb-9a9a-d4d471ce84dd None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:37.877902 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0addee-632e-42bb-9a9a-d4d471ce84dd None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:37.878059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0addee-632e-42bb-9a9a-d4d471ce84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:37.897533 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-cb0addee-632e-42bb-9a9a-d4d471ce84dd None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:37.898732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-cb0addee-632e-42bb-9a9a-d4d471ce84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:37.906331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 465/954] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:38.241765 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2205-7afb-48d4-97d7-a9171c0d0866 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:38.252367 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f2205-7afb-48d4-97d7-a9171c0d0866 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:38.255816 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9dad6-96b9-4c58-bc2e-508b66266528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:38.256429 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9dad6-96b9-4c58-bc2e-508b66266528 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:38.256708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9dad6-96b9-4c58-bc2e-508b66266528 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:38.257013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9dad6-96b9-4c58-bc2e-508b66266528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:38.265601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9dad6-96b9-4c58-bc2e-508b66266528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:38.267021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9dad6-96b9-4c58-bc2e-508b66266528 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:38.276708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 490/955] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:40.786101 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eceba-0e3b-4d19-bd73-0908dad96c7b None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:40.786625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eceba-0e3b-4d19-bd73-0908dad96c7b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:40.786625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eceba-0e3b-4d19-bd73-0908dad96c7b None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:40.788508 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 466/956] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:40.793619 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997921e-5f35-4631-a494-9e85f7b1b2df None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:40.794037 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997921e-5f35-4631-a494-9e85f7b1b2df None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:40.794153 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997921e-5f35-4631-a494-9e85f7b1b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:40.812744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-e997921e-5f35-4631-a494-9e85f7b1b2df None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:40.813963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-e997921e-5f35-4631-a494-9e85f7b1b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:40.821744 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 491/957] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:41.166616 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eceba-0e3b-4d19-bd73-0908dad96c7b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:41.177127 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eceba-0e3b-4d19-bd73-0908dad96c7b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:41.181231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120f8bf-d6c7-4c40-bd01-b6509837f87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:41.181816 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f8bf-d6c7-4c40-bd01-b6509837f87b service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:41.182092 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f8bf-d6c7-4c40-bd01-b6509837f87b service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:41.182359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f8bf-d6c7-4c40-bd01-b6509837f87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:41.190891 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f8bf-d6c7-4c40-bd01-b6509837f87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:41.192577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f8bf-d6c7-4c40-bd01-b6509837f87b service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:41.202401 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 467/958] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:43.873267 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31781615-fb0c-4a08-8086-9098d9c2c692 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:43.873831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31781615-fb0c-4a08-8086-9098d9c2c692 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:43.873831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31781615-fb0c-4a08-8086-9098d9c2c692 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:43.875185 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 492/959] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:43.880154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b7627-1759-4656-a8ae-dd5cb073b8a1 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:43.880547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b7627-1759-4656-a8ae-dd5cb073b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:43.880688 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b7627-1759-4656-a8ae-dd5cb073b8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:43.901416 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-b68b7627-1759-4656-a8ae-dd5cb073b8a1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:43.903222 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-b68b7627-1759-4656-a8ae-dd5cb073b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:43.915345 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 468/960] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:43 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:44.250226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31781615-fb0c-4a08-8086-9098d9c2c692 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:44.261329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31781615-fb0c-4a08-8086-9098d9c2c692 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:44.264969 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58061617-116b-4e8a-83ae-fe0f600489df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:44.265546 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58061617-116b-4e8a-83ae-fe0f600489df service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:44.265819 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58061617-116b-4e8a-83ae-fe0f600489df service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:44.266081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58061617-116b-4e8a-83ae-fe0f600489df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:44.274926 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58061617-116b-4e8a-83ae-fe0f600489df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:44.276334 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58061617-116b-4e8a-83ae-fe0f600489df service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:44.289284 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 493/961] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:44 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:48.592450 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccd667-f05d-45dd-b2e4-6246211c4ba3 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:48.592976 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccd667-f05d-45dd-b2e4-6246211c4ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:48.593065 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccd667-f05d-45dd-b2e4-6246211c4ba3 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:48.594366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 469/962] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:48.599985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede4bd-f78c-451e-85e9-5414cde9fc99 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:48.600362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede4bd-f78c-451e-85e9-5414cde9fc99 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:48.600650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede4bd-f78c-451e-85e9-5414cde9fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:48.621406 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-e9ede4bd-f78c-451e-85e9-5414cde9fc99 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:48.622710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-e9ede4bd-f78c-451e-85e9-5414cde9fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:48.631319 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 494/963] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:48.969997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccd667-f05d-45dd-b2e4-6246211c4ba3 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:48.976049 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=77 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:35:48.982462 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccd667-f05d-45dd-b2e4-6246211c4ba3 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:48.985956 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4cd9-1c30-4b3f-9c2c-7b9145104f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:48.986550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4cd9-1c30-4b3f-9c2c-7b9145104f43 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:48.986821 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4cd9-1c30-4b3f-9c2c-7b9145104f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:48.987593 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4cd9-1c30-4b3f-9c2c-7b9145104f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:48.996224 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4cd9-1c30-4b3f-9c2c-7b9145104f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:48.997674 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4cd9-1c30-4b3f-9c2c-7b9145104f43 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:49.007442 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 470/964] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:52.060250 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc740-fd70-4dcb-ad1c-8729dbba507a None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:52.060779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc740-fd70-4dcb-ad1c-8729dbba507a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:52.060779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc740-fd70-4dcb-ad1c-8729dbba507a None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:52.062137 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 495/965] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:52.067597 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d2a5-142c-4d79-ad5b-0af3f2eeefbb None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:52.068036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d2a5-142c-4d79-ad5b-0af3f2eeefbb None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:52.068293 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d2a5-142c-4d79-ad5b-0af3f2eeefbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:52.088285 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-6110d2a5-142c-4d79-ad5b-0af3f2eeefbb None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:52.089513 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-6110d2a5-142c-4d79-ad5b-0af3f2eeefbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:52.097664 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 471/966] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:52 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:52.443628 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc740-fd70-4dcb-ad1c-8729dbba507a None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:52.449026 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=48 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:35:52.455346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc740-fd70-4dcb-ad1c-8729dbba507a None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:52.459360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2354c0-361b-4f7f-a72e-b2e6d1d1dba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:52.459939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2354c0-361b-4f7f-a72e-b2e6d1d1dba3 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:52.460211 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2354c0-361b-4f7f-a72e-b2e6d1d1dba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:52.460477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2354c0-361b-4f7f-a72e-b2e6d1d1dba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:52.469375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2354c0-361b-4f7f-a72e-b2e6d1d1dba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:52.471144 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2354c0-361b-4f7f-a72e-b2e6d1d1dba3 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:52.480299 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 496/967] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:52 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:35:56.879315 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b31be-91be-49df-a584-beff382dafe9 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:56.879861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b31be-91be-49df-a584-beff382dafe9 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:56.879861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b31be-91be-49df-a584-beff382dafe9 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:56.881826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 472/968] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:35:56.886887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667204-c5e3-4bf1-ab12-509fe0d8ed9f None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:56.887271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667204-c5e3-4bf1-ab12-509fe0d8ed9f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:56.887480 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667204-c5e3-4bf1-ab12-509fe0d8ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:56.906900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-6e667204-c5e3-4bf1-ab12-509fe0d8ed9f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:35:56.908092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-6e667204-c5e3-4bf1-ab12-509fe0d8ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:35:56.915669 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 497/969] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:35:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:35:57.256710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b31be-91be-49df-a584-beff382dafe9 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:35:57.267666 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b31be-91be-49df-a584-beff382dafe9 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:35:57.271103 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c989-372e-4974-aab9-be57db5546a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:35:57.271685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c989-372e-4974-aab9-be57db5546a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:35:57.271959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c989-372e-4974-aab9-be57db5546a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:35:57.272227 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c989-372e-4974-aab9-be57db5546a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:35:57.280977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44c989-372e-4974-aab9-be57db5546a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:35:57.282400 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44c989-372e-4974-aab9-be57db5546a0 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:35:57.291628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 473/970] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:35:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:02.831710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5e31e-b78e-494d-8ef5-97f5a9006cb5 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:02.832191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5e31e-b78e-494d-8ef5-97f5a9006cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:02.832268 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5e31e-b78e-494d-8ef5-97f5a9006cb5 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:02.833736 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 498/971] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:02.840430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630f8c-d981-48ec-b85b-8c7fa9e87182 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:02.840887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630f8c-d981-48ec-b85b-8c7fa9e87182 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:02.841190 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630f8c-d981-48ec-b85b-8c7fa9e87182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:02.884025 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-9d630f8c-d981-48ec-b85b-8c7fa9e87182 None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:02.885512 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9d630f8c-d981-48ec-b85b-8c7fa9e87182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:02.970186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 474/972] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:36:02 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:06.901998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=8 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:36:07.465209 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae17f2-fb79-4e78-a3f5-aee4f29d793d None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:07.465492 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae17f2-fb79-4e78-a3f5-aee4f29d793d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:07.465974 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae17f2-fb79-4e78-a3f5-aee4f29d793d None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:07.467372 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 499/973] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:07.472361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63ab4-5afe-4b1a-9c2f-fde90a85b3b1 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:07.472861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63ab4-5afe-4b1a-9c2f-fde90a85b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:07.472943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63ab4-5afe-4b1a-9c2f-fde90a85b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:07.493256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f5d63ab4-5afe-4b1a-9c2f-fde90a85b3b1 None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:07.494462 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f5d63ab4-5afe-4b1a-9c2f-fde90a85b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:07.503640 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 475/974] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:36:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:09.257023 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87d14-6e7e-47e7-86fd-1380c61b8826 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:09.257509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87d14-6e7e-47e7-86fd-1380c61b8826 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:09.257509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87d14-6e7e-47e7-86fd-1380c61b8826 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:09.258811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 500/975] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:09.263740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed051-6a26-40be-88a8-2a17eafba911 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:09.264164 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed051-6a26-40be-88a8-2a17eafba911 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:09.264407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed051-6a26-40be-88a8-2a17eafba911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:09.284414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-c87ed051-6a26-40be-88a8-2a17eafba911 None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:09.285626 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-c87ed051-6a26-40be-88a8-2a17eafba911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:09.294446 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 476/976] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:36:13.275827 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9449c-a1c3-499b-b556-5a893e5b2fe4 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:13.276354 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9449c-a1c3-499b-b556-5a893e5b2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:13.276354 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9449c-a1c3-499b-b556-5a893e5b2fe4 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:13.277676 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 501/977] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:13.283219 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab351af-077d-479f-82b1-e679b95fe5f9 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:13.283613 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab351af-077d-479f-82b1-e679b95fe5f9 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:13.283834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab351af-077d-479f-82b1-e679b95fe5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:13.305276 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-fab351af-077d-479f-82b1-e679b95fe5f9 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:13.306625 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-fab351af-077d-479f-82b1-e679b95fe5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:13.315071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 477/978] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:13.699096 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0887e-b069-4d17-94ef-4aec6669816b None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:13.699379 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0887e-b069-4d17-94ef-4aec6669816b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:13.699655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0887e-b069-4d17-94ef-4aec6669816b None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:13.701013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 502/979] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 10 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:13.711645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd1d65-2a28-4740-901d-b8bc1b4a8f02 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:13.712466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd1d65-2a28-4740-901d-b8bc1b4a8f02 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:13.713041 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd1d65-2a28-4740-901d-b8bc1b4a8f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:13.757406 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-d1cd1d65-2a28-4740-901d-b8bc1b4a8f02 None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:13.758936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-d1cd1d65-2a28-4740-901d-b8bc1b4a8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:13.834230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:36:13.840837 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 478/980] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 10 20:36:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:13.849934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0887e-b069-4d17-94ef-4aec6669816b None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:13.865820 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0887e-b069-4d17-94ef-4aec6669816b None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:13.871233 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2263701-5a84-4f84-a764-e3c2f78c99e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:13.871831 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263701-5a84-4f84-a764-e3c2f78c99e6 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:13.872108 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263701-5a84-4f84-a764-e3c2f78c99e6 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:13.872385 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263701-5a84-4f84-a764-e3c2f78c99e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:13.880996 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2263701-5a84-4f84-a764-e3c2f78c99e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:13.882570 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2263701-5a84-4f84-a764-e3c2f78c99e6 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:13.892452 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 503/981] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:36:16.543152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c3d9-d7c6-462f-9af8-48dd631978b1 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:16.543696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c3d9-d7c6-462f-9af8-48dd631978b1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:16.543696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c3d9-d7c6-462f-9af8-48dd631978b1 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:16.545346 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 479/982] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:16.550643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fa15-f7c8-4fdd-a646-d67599311271 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:16.551067 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fa15-f7c8-4fdd-a646-d67599311271 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:16.551184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fa15-f7c8-4fdd-a646-d67599311271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:16.571217 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-b439fa15-f7c8-4fdd-a646-d67599311271 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:16.572404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-b439fa15-f7c8-4fdd-a646-d67599311271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:16.580108 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 504/983] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:16.920969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c3d9-d7c6-462f-9af8-48dd631978b1 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:16.935773 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c3d9-d7c6-462f-9af8-48dd631978b1 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:16.940740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a44c1-4d8b-457e-84a6-b203702e3ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:16.941423 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a44c1-4d8b-457e-84a6-b203702e3ab3 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:16.942209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a44c1-4d8b-457e-84a6-b203702e3ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:16.942588 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a44c1-4d8b-457e-84a6-b203702e3ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:16.951138 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a44c1-4d8b-457e-84a6-b203702e3ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:16.952943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a44c1-4d8b-457e-84a6-b203702e3ab3 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:16.963931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 480/984] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:19.767847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241501-3c91-4138-a31e-355a2da3a4c2 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:19.767847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241501-3c91-4138-a31e-355a2da3a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:19.768338 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241501-3c91-4138-a31e-355a2da3a4c2 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:19.769655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 505/985] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:19.775593 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad466d-9d7d-48d4-9971-14713630cdd7 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:19.776022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad466d-9d7d-48d4-9971-14713630cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:19.776135 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad466d-9d7d-48d4-9971-14713630cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:19.798712 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-0bad466d-9d7d-48d4-9971-14713630cdd7 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:19.800720 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-0bad466d-9d7d-48d4-9971-14713630cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:19.811328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 481/986] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:20.154324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91565af-8eab-4bba-92d8-30fc9c387605 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:20.154608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91565af-8eab-4bba-92d8-30fc9c387605 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:20.154880 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91565af-8eab-4bba-92d8-30fc9c387605 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:20.156196 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 506/987] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 10 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:20.162779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a2b64-4e4c-402a-8360-bfc9392766ab None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:20.163068 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a2b64-4e4c-402a-8360-bfc9392766ab None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:20.163343 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a2b64-4e4c-402a-8360-bfc9392766ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:20.187026 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-665a2b64-4e4c-402a-8360-bfc9392766ab None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:20.188626 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-665a2b64-4e4c-402a-8360-bfc9392766ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:20.199243 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 482/988] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 10 20:36:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:36:20.208640 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91565af-8eab-4bba-92d8-30fc9c387605 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:20.227358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91565af-8eab-4bba-92d8-30fc9c387605 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:20.234370 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140dbf9-264a-46bb-b1c9-dd3a2277de6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:20.234978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140dbf9-264a-46bb-b1c9-dd3a2277de6a service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:20.235261 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140dbf9-264a-46bb-b1c9-dd3a2277de6a service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:20.235536 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140dbf9-264a-46bb-b1c9-dd3a2277de6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:20.245582 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140dbf9-264a-46bb-b1c9-dd3a2277de6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:20.247299 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140dbf9-264a-46bb-b1c9-dd3a2277de6a service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:20.257377 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 507/989] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:22.844094 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b373c-c3fe-48c7-a351-dc5fef7350bd None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:22.845162 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b373c-c3fe-48c7-a351-dc5fef7350bd None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:22.845666 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b373c-c3fe-48c7-a351-dc5fef7350bd None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:22.851805 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 483/990] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:22.853178 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8f658-c3c4-47ff-bbd7-61dd45776a3c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:22.854042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8f658-c3c4-47ff-bbd7-61dd45776a3c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:22.854518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8f658-c3c4-47ff-bbd7-61dd45776a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:22.875073 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-6eb8f658-c3c4-47ff-bbd7-61dd45776a3c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:22.876675 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-6eb8f658-c3c4-47ff-bbd7-61dd45776a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:22.885534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 508/991] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:36:23.271029 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b373c-c3fe-48c7-a351-dc5fef7350bd None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:23.286057 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b373c-c3fe-48c7-a351-dc5fef7350bd None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:23.291740 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d07df-50a9-4132-af1e-206496606879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:23.292662 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d07df-50a9-4132-af1e-206496606879 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:23.293204 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d07df-50a9-4132-af1e-206496606879 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:23.293676 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d07df-50a9-4132-af1e-206496606879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:23.303890 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d07df-50a9-4132-af1e-206496606879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:23.305818 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d07df-50a9-4132-af1e-206496606879 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:23.333143 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 484/992] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:23.663987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1985-cb7b-4d2b-aae5-b637c228861e None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:23.664272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1985-cb7b-4d2b-aae5-b637c228861e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:23.664547 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1985-cb7b-4d2b-aae5-b637c228861e None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:23.672082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702392ed-b3a3-4e20-a1d3-0a65f7db366a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:23.672339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702392ed-b3a3-4e20-a1d3-0a65f7db366a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:23.672615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702392ed-b3a3-4e20-a1d3-0a65f7db366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:23.676339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 509/993] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:23.700019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-702392ed-b3a3-4e20-a1d3-0a65f7db366a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:23.701580 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-702392ed-b3a3-4e20-a1d3-0a65f7db366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:23.721619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 485/994] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:24.121069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab7c5-fd7c-4e82-b77c-21c706f8826b None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:24.121624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab7c5-fd7c-4e82-b77c-21c706f8826b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:24.121768 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab7c5-fd7c-4e82-b77c-21c706f8826b None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:24.123707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 510/995] 10.222.0.16 () {54 vars in 964 bytes} [Sat Sep 10 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:24.132291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bf5e-f4d4-41d9-a121-a666bb0592b9 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:24.132291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bf5e-f4d4-41d9-a121-a666bb0592b9 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:24.132291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bf5e-f4d4-41d9-a121-a666bb0592b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:24.169566 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-91b1bf5e-f4d4-41d9-a121-a666bb0592b9 None None] MFA Rules not processed for user `6fbd946e624a40a5ba757daa22cec6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:24.170772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-91b1bf5e-f4d4-41d9-a121-a666bb0592b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:24.234653 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 486/996] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Sep 10 20:36:24 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:24.242621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab7c5-fd7c-4e82-b77c-21c706f8826b None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:24.253359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab7c5-fd7c-4e82-b77c-21c706f8826b None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:24.256980 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6df08-8ad5-4ec0-871e-d297e1e18b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd946e624a40a5ba757daa22cec6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:24.257573 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6df08-8ad5-4ec0-871e-d297e1e18b19 service cinder] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:24.257849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6df08-8ad5-4ec0-871e-d297e1e18b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:24.258117 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6df08-8ad5-4ec0-871e-d297e1e18b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:24.268110 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6df08-8ad5-4ec0-871e-d297e1e18b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:24.269576 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6df08-8ad5-4ec0-871e-d297e1e18b19 service cinder] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:24.279724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 511/997] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:25.914638 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6dd16-77cb-4b71-b637-700335adc602 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:25.915202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6dd16-77cb-4b71-b637-700335adc602 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:25.915202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6dd16-77cb-4b71-b637-700335adc602 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:25.916501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 487/998] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:25.922007 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f072ab-c2f3-4e00-a5df-251e38873bc6 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:25.922469 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f072ab-c2f3-4e00-a5df-251e38873bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:25.922590 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f072ab-c2f3-4e00-a5df-251e38873bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:25.943389 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-80f072ab-c2f3-4e00-a5df-251e38873bc6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:25.944673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-80f072ab-c2f3-4e00-a5df-251e38873bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:25.952432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 512/999] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:26.300361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6dd16-77cb-4b71-b637-700335adc602 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:26.313858 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6dd16-77cb-4b71-b637-700335adc602 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:26.319291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52203d66-9717-4f88-bd74-ef66555e1586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:26.319876 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203d66-9717-4f88-bd74-ef66555e1586 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:26.320155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203d66-9717-4f88-bd74-ef66555e1586 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:26.320426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203d66-9717-4f88-bd74-ef66555e1586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:26.328357 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52203d66-9717-4f88-bd74-ef66555e1586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:26.329958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52203d66-9717-4f88-bd74-ef66555e1586 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:26.339705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 488/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:28.783527 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd865158-e7c6-4d9a-aaa9-c804e962e854 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:28.784444 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd865158-e7c6-4d9a-aaa9-c804e962e854 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:28.784731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd865158-e7c6-4d9a-aaa9-c804e962e854 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:28.786404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 513/1001] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:28.791705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba9beb-b9f8-4871-a323-6e577e1e7ebe None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:28.792125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba9beb-b9f8-4871-a323-6e577e1e7ebe None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:28.792263 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba9beb-b9f8-4871-a323-6e577e1e7ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:28.812426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-94ba9beb-b9f8-4871-a323-6e577e1e7ebe None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:28.813839 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-94ba9beb-b9f8-4871-a323-6e577e1e7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:28.822946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 489/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:29.172195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd865158-e7c6-4d9a-aaa9-c804e962e854 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:29.186594 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd865158-e7c6-4d9a-aaa9-c804e962e854 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:29.191476 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d6a2-4130-4e40-b811-bd49e88f9006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:29.192414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d6a2-4130-4e40-b811-bd49e88f9006 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:29.192753 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d6a2-4130-4e40-b811-bd49e88f9006 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:29.193133 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d6a2-4130-4e40-b811-bd49e88f9006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:29.201112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7d6a2-4130-4e40-b811-bd49e88f9006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:29.202664 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7d6a2-4130-4e40-b811-bd49e88f9006 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:29.212106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 514/1003] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:31.695540 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1abe78-255c-4054-b5f0-28bf29a04ec3 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:31.696096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1abe78-255c-4054-b5f0-28bf29a04ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:31.696096 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1abe78-255c-4054-b5f0-28bf29a04ec3 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:31.697381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 490/1004] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:31.703029 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb586-be48-43b4-b941-8dba072e4322 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:31.703531 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb586-be48-43b4-b941-8dba072e4322 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:31.703633 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb586-be48-43b4-b941-8dba072e4322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:31.723580 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-9f4cb586-be48-43b4-b941-8dba072e4322 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:31.724773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-9f4cb586-be48-43b4-b941-8dba072e4322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:31.733082 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 515/1005] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:32.073101 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1abe78-255c-4054-b5f0-28bf29a04ec3 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:32.086827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1abe78-255c-4054-b5f0-28bf29a04ec3 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:32.091808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f22e-c5f9-47f4-99c2-48d946967444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:32.092392 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f22e-c5f9-47f4-99c2-48d946967444 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:32.092838 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f22e-c5f9-47f4-99c2-48d946967444 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:32.093116 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f22e-c5f9-47f4-99c2-48d946967444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:32.101885 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721f22e-c5f9-47f4-99c2-48d946967444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:32.103458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721f22e-c5f9-47f4-99c2-48d946967444 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:32.114587 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 491/1006] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:35.085987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307662e-3016-4318-8af7-4bdab9d75213 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:35.086733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307662e-3016-4318-8af7-4bdab9d75213 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:35.086733 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307662e-3016-4318-8af7-4bdab9d75213 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:35.088016 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 516/1007] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:35.094567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f3f8-278a-410b-9499-492cb81c6d8b None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:35.095128 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f3f8-278a-410b-9499-492cb81c6d8b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:35.095311 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f3f8-278a-410b-9499-492cb81c6d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:35.115808 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-8237f3f8-278a-410b-9499-492cb81c6d8b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:35.117043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-8237f3f8-278a-410b-9499-492cb81c6d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:35.124873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 492/1008] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:35.527846 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307662e-3016-4318-8af7-4bdab9d75213 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:35.541995 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307662e-3016-4318-8af7-4bdab9d75213 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:35.547093 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d7b5b-a090-4b54-9ea3-f6db1e5dfb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:35.547694 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7b5b-a090-4b54-9ea3-f6db1e5dfb7d service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:35.547981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7b5b-a090-4b54-9ea3-f6db1e5dfb7d service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:35.548269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d7b5b-a090-4b54-9ea3-f6db1e5dfb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:35.558929 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d7b5b-a090-4b54-9ea3-f6db1e5dfb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:35.560623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d7b5b-a090-4b54-9ea3-f6db1e5dfb7d service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:35.570430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 517/1009] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:38.792607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed63857-8c3d-4613-a0e4-7b99fb14fbf8 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:38.792607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed63857-8c3d-4613-a0e4-7b99fb14fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:38.792607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed63857-8c3d-4613-a0e4-7b99fb14fbf8 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:38.792607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 493/1010] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:38.795188 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf8fb-1e06-4f93-a175-6bf24277770b None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:38.795656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf8fb-1e06-4f93-a175-6bf24277770b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:38.795770 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf8fb-1e06-4f93-a175-6bf24277770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:38.803044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=43 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:36:38.819597 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-6adaf8fb-1e06-4f93-a175-6bf24277770b None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:38.820838 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-6adaf8fb-1e06-4f93-a175-6bf24277770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:38.828714 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 518/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:39.173013 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed63857-8c3d-4613-a0e4-7b99fb14fbf8 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:39.186779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed63857-8c3d-4613-a0e4-7b99fb14fbf8 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:39.192491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40afd57-95b5-48da-a341-a606a18676ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:39.193133 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40afd57-95b5-48da-a341-a606a18676ef service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:39.193412 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40afd57-95b5-48da-a341-a606a18676ef service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:39.193682 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40afd57-95b5-48da-a341-a606a18676ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:39.201885 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40afd57-95b5-48da-a341-a606a18676ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:39.203460 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40afd57-95b5-48da-a341-a606a18676ef service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:39.212850 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 494/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:40.449647 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0f6a3-acbf-426e-ad76-db47394d694a None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:40.450223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0f6a3-acbf-426e-ad76-db47394d694a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:40.450223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0f6a3-acbf-426e-ad76-db47394d694a None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:40.451561 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 519/1013] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:40.457497 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72aba-03db-486d-8816-b1ca21f6a90f None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:40.457917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72aba-03db-486d-8816-b1ca21f6a90f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:40.458108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72aba-03db-486d-8816-b1ca21f6a90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:40.477097 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f3f72aba-03db-486d-8816-b1ca21f6a90f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:40.478311 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f3f72aba-03db-486d-8816-b1ca21f6a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:40.486006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 495/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:40.844278 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ff982-4c96-44e6-86ff-d22fa48bf31c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:40.844562 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ff982-4c96-44e6-86ff-d22fa48bf31c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:40.844862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ff982-4c96-44e6-86ff-d22fa48bf31c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:40.846322 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 520/1015] 10.222.0.16 () {54 vars in 966 bytes} [Sat Sep 10 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:36:40.852323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427aa2-2585-4837-a610-6c76c851643a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:40.852609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427aa2-2585-4837-a610-6c76c851643a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:40.852931 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427aa2-2585-4837-a610-6c76c851643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:40.889535 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-70427aa2-2585-4837-a610-6c76c851643a None None] MFA Rules not processed for user `a2edea27275f4d75831629f1de22d43d`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:40.890747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-70427aa2-2585-4837-a610-6c76c851643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:40.911943 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:36:40.950354 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 496/1016] 10.222.0.16 () {58 vars in 1063 bytes} [Sat Sep 10 20:36:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:40.958418 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ff982-4c96-44e6-86ff-d22fa48bf31c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:40.969031 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ff982-4c96-44e6-86ff-d22fa48bf31c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:40.973206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323653fe-678f-45aa-8e1a-6d8e9d76899c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2edea27275f4d75831629f1de22d43d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:40.973990 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323653fe-678f-45aa-8e1a-6d8e9d76899c service glance] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:40.974265 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323653fe-678f-45aa-8e1a-6d8e9d76899c service glance] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:40.974533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323653fe-678f-45aa-8e1a-6d8e9d76899c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:40.983724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323653fe-678f-45aa-8e1a-6d8e9d76899c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:40.985205 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323653fe-678f-45aa-8e1a-6d8e9d76899c service glance] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:40.994857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 521/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:41.641313 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11110a6c-0dbb-4deb-9894-cce06e0564e3 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:41.641912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11110a6c-0dbb-4deb-9894-cce06e0564e3 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:41.641912 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11110a6c-0dbb-4deb-9894-cce06e0564e3 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:41.643202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 497/1018] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:41.649024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4495-6ae8-44f6-bab2-485cb75557db None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:41.649501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4495-6ae8-44f6-bab2-485cb75557db None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:41.649607 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4495-6ae8-44f6-bab2-485cb75557db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:41.669472 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-ce9b4495-6ae8-44f6-bab2-485cb75557db None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:41.670605 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-ce9b4495-6ae8-44f6-bab2-485cb75557db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:41.678413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 522/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:36:42.028861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11110a6c-0dbb-4deb-9894-cce06e0564e3 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:42.043195 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11110a6c-0dbb-4deb-9894-cce06e0564e3 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:42.048259 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16acbe-ceae-45fa-abe9-0a987c905999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:42.048892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16acbe-ceae-45fa-abe9-0a987c905999 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:42.049172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16acbe-ceae-45fa-abe9-0a987c905999 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:42.049444 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16acbe-ceae-45fa-abe9-0a987c905999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:42.060304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16acbe-ceae-45fa-abe9-0a987c905999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:42.061924 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16acbe-ceae-45fa-abe9-0a987c905999 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:42.074316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 498/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:44.676636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994d07-ea65-4cae-b244-455220040d40 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:44.677273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994d07-ea65-4cae-b244-455220040d40 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:44.677273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994d07-ea65-4cae-b244-455220040d40 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:44.678588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 523/1021] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:44.684071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12f336-deeb-4dcb-bbbb-7b50284dc89e None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:44.684598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12f336-deeb-4dcb-bbbb-7b50284dc89e None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:44.684598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12f336-deeb-4dcb-bbbb-7b50284dc89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:44.705540 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-ee12f336-deeb-4dcb-bbbb-7b50284dc89e None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:44.707292 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-ee12f336-deeb-4dcb-bbbb-7b50284dc89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:44.717204 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 499/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:45.063501 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994d07-ea65-4cae-b244-455220040d40 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:45.077321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994d07-ea65-4cae-b244-455220040d40 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:45.082325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7502e-8411-4151-8430-32ae04844dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:45.082987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7502e-8411-4151-8430-32ae04844dfd service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:45.083335 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7502e-8411-4151-8430-32ae04844dfd service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:45.087755 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7502e-8411-4151-8430-32ae04844dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:45.096735 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7502e-8411-4151-8430-32ae04844dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:45.099114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7502e-8411-4151-8430-32ae04844dfd service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:45.109102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 524/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:47.694165 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e21f8-f38f-4fb9-a772-0a54dc12ef9a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:47.694791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e21f8-f38f-4fb9-a772-0a54dc12ef9a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:47.694896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e21f8-f38f-4fb9-a772-0a54dc12ef9a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:47.696280 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 500/1024] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:47.701857 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebdf92-4e86-4f68-aeee-197a496ea03c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:47.702337 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebdf92-4e86-4f68-aeee-197a496ea03c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:47.702438 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebdf92-4e86-4f68-aeee-197a496ea03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:47.725458 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-31ebdf92-4e86-4f68-aeee-197a496ea03c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:47.727196 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-31ebdf92-4e86-4f68-aeee-197a496ea03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:47.734994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 525/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:36:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:48.075279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e21f8-f38f-4fb9-a772-0a54dc12ef9a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:48.089132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e21f8-f38f-4fb9-a772-0a54dc12ef9a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:48.093988 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0827b-f30c-4271-b8a0-edda90fb9c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:48.094570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0827b-f30c-4271-b8a0-edda90fb9c17 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:48.094865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0827b-f30c-4271-b8a0-edda90fb9c17 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:48.095254 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0827b-f30c-4271-b8a0-edda90fb9c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:48.103870 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0827b-f30c-4271-b8a0-edda90fb9c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:48.105484 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0827b-f30c-4271-b8a0-edda90fb9c17 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:48.115338 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 501/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:36:56.336542 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1843-7fc4-44a6-8454-abdb4c81e4a3 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:56.337128 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1843-7fc4-44a6-8454-abdb4c81e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:56.337128 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1843-7fc4-44a6-8454-abdb4c81e4a3 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:56.338506 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 526/1027] 10.222.0.16 () {54 vars in 918 bytes} [Sat Sep 10 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:56.343454 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97fb9-60e4-42d6-8598-6d2a5b8e3138 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:56.343926 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97fb9-60e4-42d6-8598-6d2a5b8e3138 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:56.344030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97fb9-60e4-42d6-8598-6d2a5b8e3138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:56.363593 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f4e97fb9-60e4-42d6-8598-6d2a5b8e3138 None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:56.364773 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f4e97fb9-60e4-42d6-8598-6d2a5b8e3138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:56.373366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 502/1028] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Sep 10 20:36:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:56.387778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0d9be-e461-4c56-b6d0-f858339d6b72 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:56.388120 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0d9be-e461-4c56-b6d0-f858339d6b72 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:56.388393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0d9be-e461-4c56-b6d0-f858339d6b72 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:56.389708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 527/1029] 10.222.0.16 () {54 vars in 918 bytes} [Sat Sep 10 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:56.394733 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec064d-a48e-44d0-ae91-feb22489e759 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:56.395016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec064d-a48e-44d0-ae91-feb22489e759 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:56.395312 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec064d-a48e-44d0-ae91-feb22489e759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:56.413823 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f5ec064d-a48e-44d0-ae91-feb22489e759 None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:56.414999 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f5ec064d-a48e-44d0-ae91-feb22489e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:56.423217 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 503/1030] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Sep 10 20:36:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:57.720179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=20 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:36:59.251558 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1c988-c9f1-4ef7-b90e-9d31c6c817ce None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:59.252171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1c988-c9f1-4ef7-b90e-9d31c6c817ce None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:59.252171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1c988-c9f1-4ef7-b90e-9d31c6c817ce None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:59.253899 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 528/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:36:59.259266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83733-5240-4648-af79-caf442e1daaf None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:59.259725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83733-5240-4648-af79-caf442e1daaf None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:59.259865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83733-5240-4648-af79-caf442e1daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:59.279203 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-bbf83733-5240-4648-af79-caf442e1daaf None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:36:59.280381 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-bbf83733-5240-4648-af79-caf442e1daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:36:59.288037 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 504/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:36:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:36:59.624273 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1c988-c9f1-4ef7-b90e-9d31c6c817ce None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:36:59.638156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1c988-c9f1-4ef7-b90e-9d31c6c817ce None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:36:59.643060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d0cad-1b89-415a-9ac1-a89f75eb1119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:36:59.643490 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0cad-1b89-415a-9ac1-a89f75eb1119 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:36:59.644258 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0cad-1b89-415a-9ac1-a89f75eb1119 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:36:59.644631 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0cad-1b89-415a-9ac1-a89f75eb1119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:36:59.653225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0cad-1b89-415a-9ac1-a89f75eb1119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:36:59.654783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0cad-1b89-415a-9ac1-a89f75eb1119 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:36:59.664435 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 529/1033] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:36:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:37:01.385165 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa534f-bc26-46d8-8dd6-7ddaef0a301e None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:01.385694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa534f-bc26-46d8-8dd6-7ddaef0a301e None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:01.385694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa534f-bc26-46d8-8dd6-7ddaef0a301e None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:01.387085 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 505/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:01.391925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4ad08-5ab9-4792-a9ff-076895f03e7c None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:01.392333 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4ad08-5ab9-4792-a9ff-076895f03e7c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:01.392474 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4ad08-5ab9-4792-a9ff-076895f03e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:01.411973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-27b4ad08-5ab9-4792-a9ff-076895f03e7c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:01.413203 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-27b4ad08-5ab9-4792-a9ff-076895f03e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:01.420970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 530/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:01.606386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa534f-bc26-46d8-8dd6-7ddaef0a301e None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:01.620262 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa534f-bc26-46d8-8dd6-7ddaef0a301e None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:01.625098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487ac1b-89c8-4196-ba25-925043bbeb35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:01.625680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ac1b-89c8-4196-ba25-925043bbeb35 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:01.625960 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ac1b-89c8-4196-ba25-925043bbeb35 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:01.626232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ac1b-89c8-4196-ba25-925043bbeb35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:01.634155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487ac1b-89c8-4196-ba25-925043bbeb35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:01.635781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487ac1b-89c8-4196-ba25-925043bbeb35 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:01.644901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 506/1036] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:03.349251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4fa1-76b8-42ed-9021-37475aa8aa62 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:03.349853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4fa1-76b8-42ed-9021-37475aa8aa62 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:03.349853 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4fa1-76b8-42ed-9021-37475aa8aa62 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:03.351123 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 531/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:03.355981 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875284e-d234-4e02-8287-bca5dc8fb5ac None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:03.356439 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875284e-d234-4e02-8287-bca5dc8fb5ac None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:03.356543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875284e-d234-4e02-8287-bca5dc8fb5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:03.376025 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-7875284e-d234-4e02-8287-bca5dc8fb5ac None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:03.377384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-7875284e-d234-4e02-8287-bca5dc8fb5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:03.385752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 507/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:03.542636 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4fa1-76b8-42ed-9021-37475aa8aa62 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:03.556601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4fa1-76b8-42ed-9021-37475aa8aa62 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:03.561560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5283b06-21ce-4bd8-816c-1bc145e828c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:03.562147 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5283b06-21ce-4bd8-816c-1bc145e828c5 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:03.562426 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5283b06-21ce-4bd8-816c-1bc145e828c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:03.562703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5283b06-21ce-4bd8-816c-1bc145e828c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:03.571536 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5283b06-21ce-4bd8-816c-1bc145e828c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:03.573160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5283b06-21ce-4bd8-816c-1bc145e828c5 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:03.582290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 532/1039] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:05.227278 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cee8bf-5f13-484a-b7b8-be7adc401252 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:05.227834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cee8bf-5f13-484a-b7b8-be7adc401252 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:05.227834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cee8bf-5f13-484a-b7b8-be7adc401252 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:05.229191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 508/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:05.234415 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71f11-b451-49b2-95ce-e3c805128760 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:05.234861 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71f11-b451-49b2-95ce-e3c805128760 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:05.234973 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71f11-b451-49b2-95ce-e3c805128760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:05.255517 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-bff71f11-b451-49b2-95ce-e3c805128760 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:05.256741 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-bff71f11-b451-49b2-95ce-e3c805128760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:05.264435 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 533/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:05.421749 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cee8bf-5f13-484a-b7b8-be7adc401252 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:05.435700 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cee8bf-5f13-484a-b7b8-be7adc401252 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:05.440546 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82c36e-fcb6-4ca8-ab80-a13ae5bb4e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:05.441158 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82c36e-fcb6-4ca8-ab80-a13ae5bb4e22 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:05.441445 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82c36e-fcb6-4ca8-ab80-a13ae5bb4e22 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:05.441954 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82c36e-fcb6-4ca8-ab80-a13ae5bb4e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:05.449751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82c36e-fcb6-4ca8-ab80-a13ae5bb4e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:05.451323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82c36e-fcb6-4ca8-ab80-a13ae5bb4e22 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:05.461135 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 509/1042] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:07.160454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12e2f3-93c8-4c7e-ac97-e48107e7c962 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:07.161039 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12e2f3-93c8-4c7e-ac97-e48107e7c962 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:07.161039 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12e2f3-93c8-4c7e-ac97-e48107e7c962 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:07.162332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 534/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:07.167062 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c21b6-0954-41f5-918c-e4674b5ccc6a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:07.167501 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c21b6-0954-41f5-918c-e4674b5ccc6a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:07.167598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c21b6-0954-41f5-918c-e4674b5ccc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:07.187138 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-3c4c21b6-0954-41f5-918c-e4674b5ccc6a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:07.188322 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-3c4c21b6-0954-41f5-918c-e4674b5ccc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:07.196819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 510/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:07.352414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12e2f3-93c8-4c7e-ac97-e48107e7c962 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:07.366132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12e2f3-93c8-4c7e-ac97-e48107e7c962 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:07.371005 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab289de-bd5b-4ad1-bc4b-f8cb53f09349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:07.371616 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab289de-bd5b-4ad1-bc4b-f8cb53f09349 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:07.371893 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab289de-bd5b-4ad1-bc4b-f8cb53f09349 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:07.372160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab289de-bd5b-4ad1-bc4b-f8cb53f09349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:07.380006 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab289de-bd5b-4ad1-bc4b-f8cb53f09349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:07.381623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab289de-bd5b-4ad1-bc4b-f8cb53f09349 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:07.390644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 535/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:09.003803 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67308-17f2-47ce-84f7-91de5c02e32a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:09.004301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67308-17f2-47ce-84f7-91de5c02e32a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:09.004403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67308-17f2-47ce-84f7-91de5c02e32a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:09.005714 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 511/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:09.010672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613c45-c6af-43db-b5ab-339f8e6c5e2d None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:09.011079 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613c45-c6af-43db-b5ab-339f8e6c5e2d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:09.011213 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613c45-c6af-43db-b5ab-339f8e6c5e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:09.030739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-60613c45-c6af-43db-b5ab-339f8e6c5e2d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:09.031913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-60613c45-c6af-43db-b5ab-339f8e6c5e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:09.039571 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 536/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:09.195596 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67308-17f2-47ce-84f7-91de5c02e32a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:09.209308 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67308-17f2-47ce-84f7-91de5c02e32a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:09.214172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f59dd-4aa9-42c2-8bac-5a6e3f513e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:09.214767 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f59dd-4aa9-42c2-8bac-5a6e3f513e9a service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:09.215044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f59dd-4aa9-42c2-8bac-5a6e3f513e9a service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:09.215317 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f59dd-4aa9-42c2-8bac-5a6e3f513e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:09.223743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f59dd-4aa9-42c2-8bac-5a6e3f513e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:09.225359 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f59dd-4aa9-42c2-8bac-5a6e3f513e9a service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:09.234373 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 512/1048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:10.836579 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649235-ed1e-4e88-9844-4f97ce2a272c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:10.837152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649235-ed1e-4e88-9844-4f97ce2a272c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:10.837152 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649235-ed1e-4e88-9844-4f97ce2a272c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:10.838473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 537/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:10.843380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee039e-67c4-4802-8db5-32af075943e1 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:10.843781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee039e-67c4-4802-8db5-32af075943e1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:10.843925 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee039e-67c4-4802-8db5-32af075943e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:10.863977 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-6fee039e-67c4-4802-8db5-32af075943e1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:10.865291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-6fee039e-67c4-4802-8db5-32af075943e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:10.873006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 513/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:11.029691 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0649235-ed1e-4e88-9844-4f97ce2a272c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:11.042771 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0649235-ed1e-4e88-9844-4f97ce2a272c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:11.047564 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2a68a-0284-4431-b81d-2443c806520d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:11.048145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2a68a-0284-4431-b81d-2443c806520d service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:11.048421 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2a68a-0284-4431-b81d-2443c806520d service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:11.048691 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2a68a-0284-4431-b81d-2443c806520d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:11.057220 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2a68a-0284-4431-b81d-2443c806520d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:11.058790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2a68a-0284-4431-b81d-2443c806520d service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:11.068682 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 538/1051] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:12.652368 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dcf47-6dae-4d90-9938-d3f348299b24 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:12.652971 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dcf47-6dae-4d90-9938-d3f348299b24 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:12.652971 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dcf47-6dae-4d90-9938-d3f348299b24 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:12.654269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 514/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:12.659132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c5ec9-cd1f-42e2-8a25-02409e8b1187 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:12.659554 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c5ec9-cd1f-42e2-8a25-02409e8b1187 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:12.659674 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c5ec9-cd1f-42e2-8a25-02409e8b1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:12.678784 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-170c5ec9-cd1f-42e2-8a25-02409e8b1187 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:12.680077 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-170c5ec9-cd1f-42e2-8a25-02409e8b1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:12.687874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 539/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:12.846857 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dcf47-6dae-4d90-9938-d3f348299b24 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:12.854369 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=67 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:37:12.862511 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dcf47-6dae-4d90-9938-d3f348299b24 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:12.867437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c189b-9dd4-4162-bcfb-631854cee7fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:12.868027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c189b-9dd4-4162-bcfb-631854cee7fc service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:12.868306 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c189b-9dd4-4162-bcfb-631854cee7fc service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:12.868575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c189b-9dd4-4162-bcfb-631854cee7fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:12.876534 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c189b-9dd4-4162-bcfb-631854cee7fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:12.878171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c189b-9dd4-4162-bcfb-631854cee7fc service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:12.890451 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 515/1054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:14.499552 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4672ae2-97e2-441d-b65b-01f85599e186 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:14.500008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4672ae2-97e2-441d-b65b-01f85599e186 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:14.500114 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4672ae2-97e2-441d-b65b-01f85599e186 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:14.501488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 540/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:14.507117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50988898-595f-44d2-a3a2-889189a2929c None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:14.507539 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50988898-595f-44d2-a3a2-889189a2929c None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:14.507685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50988898-595f-44d2-a3a2-889189a2929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:14.527250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-50988898-595f-44d2-a3a2-889189a2929c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:14.528678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-50988898-595f-44d2-a3a2-889189a2929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:14.537333 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 516/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:37:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:14.694052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4672ae2-97e2-441d-b65b-01f85599e186 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:14.708704 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4672ae2-97e2-441d-b65b-01f85599e186 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:14.713602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe930-e94b-4bff-9696-db38a88fb494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:14.714183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe930-e94b-4bff-9696-db38a88fb494 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:14.714454 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe930-e94b-4bff-9696-db38a88fb494 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:14.714717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe930-e94b-4bff-9696-db38a88fb494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:14.723269 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe930-e94b-4bff-9696-db38a88fb494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:14.724852 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe930-e94b-4bff-9696-db38a88fb494 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:14.733885 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 541/1057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:17.036368 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259a2e-c971-4d5b-b935-094b22c4fc81 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:17.036910 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259a2e-c971-4d5b-b935-094b22c4fc81 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:17.037019 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259a2e-c971-4d5b-b935-094b22c4fc81 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:17.038274 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 517/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:17.043657 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097054a3-b930-465a-be44-8cd8fa4384e3 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:17.044062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097054a3-b930-465a-be44-8cd8fa4384e3 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:17.044202 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097054a3-b930-465a-be44-8cd8fa4384e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:17.062943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-097054a3-b930-465a-be44-8cd8fa4384e3 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:17.064160 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-097054a3-b930-465a-be44-8cd8fa4384e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:17.072518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 542/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:17.412892 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259a2e-c971-4d5b-b935-094b22c4fc81 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:17.423477 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259a2e-c971-4d5b-b935-094b22c4fc81 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:17.427600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f022-c62c-475f-9d11-731958495611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:17.428191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f022-c62c-475f-9d11-731958495611 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:17.428466 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f022-c62c-475f-9d11-731958495611 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:17.428730 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f022-c62c-475f-9d11-731958495611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:17.437521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f022-c62c-475f-9d11-731958495611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:17.438932 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f022-c62c-475f-9d11-731958495611 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:17.448847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 518/1060] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:19.995958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626486c-5fb2-4164-b7eb-d2c8367a414b None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:19.996439 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626486c-5fb2-4164-b7eb-d2c8367a414b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:19.996548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626486c-5fb2-4164-b7eb-d2c8367a414b None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:19.997871 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 543/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:20.003816 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a728cd-a234-45ae-8d35-5305bbbe29ec None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:20.004218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a728cd-a234-45ae-8d35-5305bbbe29ec None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:20.004364 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a728cd-a234-45ae-8d35-5305bbbe29ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:20.023248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-88a728cd-a234-45ae-8d35-5305bbbe29ec None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:20.024437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-88a728cd-a234-45ae-8d35-5305bbbe29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:20.032108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 519/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:20.367355 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626486c-5fb2-4164-b7eb-d2c8367a414b None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:20.378275 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626486c-5fb2-4164-b7eb-d2c8367a414b None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:20.381811 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b6541-08dd-495d-b588-c7302fe51c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:20.382397 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b6541-08dd-495d-b588-c7302fe51c42 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:20.382672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b6541-08dd-495d-b588-c7302fe51c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:20.382936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b6541-08dd-495d-b588-c7302fe51c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:20.391695 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b6541-08dd-495d-b588-c7302fe51c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:20.393730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b6541-08dd-495d-b588-c7302fe51c42 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:20.402706 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 544/1063] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:23.111370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8199e-7fb5-450f-aabc-5096181ce168 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:23.112469 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8199e-7fb5-450f-aabc-5096181ce168 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:23.112589 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8199e-7fb5-450f-aabc-5096181ce168 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:23.113933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 520/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:23.119432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecedf6-c069-453d-b0ea-173e1286a48f None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:23.119917 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecedf6-c069-453d-b0ea-173e1286a48f None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:23.120052 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecedf6-c069-453d-b0ea-173e1286a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:23.138865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-b6ecedf6-c069-453d-b0ea-173e1286a48f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:23.140074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-b6ecedf6-c069-453d-b0ea-173e1286a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:23.147604 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 545/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:23.484370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8199e-7fb5-450f-aabc-5096181ce168 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:23.495531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8199e-7fb5-450f-aabc-5096181ce168 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:23.498974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f79b-c685-44e7-be54-1bb4ee9366e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:23.499555 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f79b-c685-44e7-be54-1bb4ee9366e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:23.499829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f79b-c685-44e7-be54-1bb4ee9366e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:23.500093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f79b-c685-44e7-be54-1bb4ee9366e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:23.509372 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56f79b-c685-44e7-be54-1bb4ee9366e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:23.510822 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56f79b-c685-44e7-be54-1bb4ee9366e4 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:23.519750 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 521/1066] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:26.026534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7b87-0d7e-436d-ac1a-c25f67f1db44 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:26.027025 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7b87-0d7e-436d-ac1a-c25f67f1db44 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:26.027149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7b87-0d7e-436d-ac1a-c25f67f1db44 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:26.028413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 546/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:26.034291 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972367-15bd-48b9-b964-60f318b05f2a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:26.034705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972367-15bd-48b9-b964-60f318b05f2a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:26.034831 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972367-15bd-48b9-b964-60f318b05f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:26.053734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-07972367-15bd-48b9-b964-60f318b05f2a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:26.054947 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-07972367-15bd-48b9-b964-60f318b05f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:26.062617 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 522/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:26.397750 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7b87-0d7e-436d-ac1a-c25f67f1db44 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:26.408661 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7b87-0d7e-436d-ac1a-c25f67f1db44 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:26.412105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2945-e81f-4188-ae03-1fde8b4bed28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:26.412686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2945-e81f-4188-ae03-1fde8b4bed28 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:26.412991 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2945-e81f-4188-ae03-1fde8b4bed28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:26.413259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2945-e81f-4188-ae03-1fde8b4bed28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:26.421749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f2945-e81f-4188-ae03-1fde8b4bed28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:26.423170 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f2945-e81f-4188-ae03-1fde8b4bed28 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:26.433059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 547/1069] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:28.895548 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5475f06-89aa-44c9-88e3-580c1d0d806b None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:28.896112 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5475f06-89aa-44c9-88e3-580c1d0d806b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:28.896112 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5475f06-89aa-44c9-88e3-580c1d0d806b None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:28.897506 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 523/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:28.902889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d1f64-c0b4-4baa-9c76-2902d52d2cd1 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:28.903321 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d1f64-c0b4-4baa-9c76-2902d52d2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:28.903427 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d1f64-c0b4-4baa-9c76-2902d52d2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:28.911435 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=61 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:37:28.924201 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-413d1f64-c0b4-4baa-9c76-2902d52d2cd1 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:28.925433 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-413d1f64-c0b4-4baa-9c76-2902d52d2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:28.933051 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 548/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:29.274570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5475f06-89aa-44c9-88e3-580c1d0d806b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:29.285653 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5475f06-89aa-44c9-88e3-580c1d0d806b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:29.289120 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b057c2-6407-4014-a105-b31ff59eedfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:29.289702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b057c2-6407-4014-a105-b31ff59eedfe service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:29.289982 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b057c2-6407-4014-a105-b31ff59eedfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:29.290252 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b057c2-6407-4014-a105-b31ff59eedfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:29.299756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b057c2-6407-4014-a105-b31ff59eedfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:29.301251 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b057c2-6407-4014-a105-b31ff59eedfe service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:29.310319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 524/1072] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:31.841293 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb8550-3c0f-4655-a61e-500796cc0d19 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:31.841900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb8550-3c0f-4655-a61e-500796cc0d19 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:31.841900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb8550-3c0f-4655-a61e-500796cc0d19 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:31.843140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 549/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:31.848519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74473-b7f3-4dc5-8777-3ddda886b25f None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:31.848951 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74473-b7f3-4dc5-8777-3ddda886b25f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:31.849103 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74473-b7f3-4dc5-8777-3ddda886b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:31.868303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-9ff74473-b7f3-4dc5-8777-3ddda886b25f None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:31.869519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9ff74473-b7f3-4dc5-8777-3ddda886b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:31.877714 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 525/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:32.214611 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb8550-3c0f-4655-a61e-500796cc0d19 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:32.225122 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb8550-3c0f-4655-a61e-500796cc0d19 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:32.228520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277011d7-df4a-4225-bf21-c77fe0f2109e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:32.229129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277011d7-df4a-4225-bf21-c77fe0f2109e service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:32.229409 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277011d7-df4a-4225-bf21-c77fe0f2109e service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:32.229686 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277011d7-df4a-4225-bf21-c77fe0f2109e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:32.238347 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277011d7-df4a-4225-bf21-c77fe0f2109e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:32.239745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277011d7-df4a-4225-bf21-c77fe0f2109e service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:32.249186 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 550/1075] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:34.694678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251e5f-8e5c-44ee-8799-09a63e8f693b None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:34.695266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251e5f-8e5c-44ee-8799-09a63e8f693b None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:34.695421 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251e5f-8e5c-44ee-8799-09a63e8f693b None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:34.697335 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 526/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:34.702483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b00d-a3d1-40ed-a3bc-2fc3d38f10c8 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:34.702918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b00d-a3d1-40ed-a3bc-2fc3d38f10c8 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:34.703036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b00d-a3d1-40ed-a3bc-2fc3d38f10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:34.722875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2475b00d-a3d1-40ed-a3bc-2fc3d38f10c8 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:34.724049 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2475b00d-a3d1-40ed-a3bc-2fc3d38f10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:34.731550 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 551/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:35.064396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251e5f-8e5c-44ee-8799-09a63e8f693b None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:35.075243 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251e5f-8e5c-44ee-8799-09a63e8f693b None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:35.078716 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff5e16-d748-465e-8cc1-072e58b9e87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:35.079303 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff5e16-d748-465e-8cc1-072e58b9e87e service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:35.079584 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff5e16-d748-465e-8cc1-072e58b9e87e service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:35.080480 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff5e16-d748-465e-8cc1-072e58b9e87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:35.089093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff5e16-d748-465e-8cc1-072e58b9e87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:35.090521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff5e16-d748-465e-8cc1-072e58b9e87e service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:35.099615 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 527/1078] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:37.526849 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794dc5-1653-4c29-a513-74ae630db807 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:37.527407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794dc5-1653-4c29-a513-74ae630db807 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:37.527407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794dc5-1653-4c29-a513-74ae630db807 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:37.528715 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 552/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:37.533964 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7f06-c523-4f7c-9fa1-e77297c9aee6 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:37.534388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7f06-c523-4f7c-9fa1-e77297c9aee6 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:37.534489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7f06-c523-4f7c-9fa1-e77297c9aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:37.553157 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-c44a7f06-c523-4f7c-9fa1-e77297c9aee6 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:37.554367 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-c44a7f06-c523-4f7c-9fa1-e77297c9aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:37.561836 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 528/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:37.900946 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794dc5-1653-4c29-a513-74ae630db807 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:37.911938 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794dc5-1653-4c29-a513-74ae630db807 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:37.915350 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76462752-8a4e-402d-a98f-9e80679d46ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:37.915924 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76462752-8a4e-402d-a98f-9e80679d46ac service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:37.916201 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76462752-8a4e-402d-a98f-9e80679d46ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:37.916468 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76462752-8a4e-402d-a98f-9e80679d46ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:37.925004 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76462752-8a4e-402d-a98f-9e80679d46ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:37.926412 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76462752-8a4e-402d-a98f-9e80679d46ac service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:37.935405 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 553/1081] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:40.324005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88fde-fd45-433e-9b47-26a3bd2867c7 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:40.324511 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88fde-fd45-433e-9b47-26a3bd2867c7 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:40.324511 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88fde-fd45-433e-9b47-26a3bd2867c7 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:40.325841 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 529/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:40.331500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172562-7e3c-4807-845e-174433820087 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:40.331939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172562-7e3c-4807-845e-174433820087 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:40.332042 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed172562-7e3c-4807-845e-174433820087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:40.350500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-ed172562-7e3c-4807-845e-174433820087 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:40.351680 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-ed172562-7e3c-4807-845e-174433820087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:40.359199 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 554/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:37:40.694205 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88fde-fd45-433e-9b47-26a3bd2867c7 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:40.705902 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88fde-fd45-433e-9b47-26a3bd2867c7 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:40.709380 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caf040-07e2-4256-aded-a5ad2da98041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:40.709958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf040-07e2-4256-aded-a5ad2da98041 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:40.710237 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf040-07e2-4256-aded-a5ad2da98041 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:40.710509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caf040-07e2-4256-aded-a5ad2da98041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:40.720496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caf040-07e2-4256-aded-a5ad2da98041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:40.722240 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caf040-07e2-4256-aded-a5ad2da98041 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:40.731638 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 530/1084] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:43.190221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed099-ec43-43a3-a325-103407b49042 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:43.190779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed099-ec43-43a3-a325-103407b49042 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:43.190779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed099-ec43-43a3-a325-103407b49042 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:43.192386 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 555/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:37:43.197670 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce48fc-652b-4da7-b0d5-fa220fd837fc None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:43.198075 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce48fc-652b-4da7-b0d5-fa220fd837fc None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:43.198217 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce48fc-652b-4da7-b0d5-fa220fd837fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:43.205398 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=51 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:37:43.217882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-30ce48fc-652b-4da7-b0d5-fa220fd837fc None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:37:43.219063 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-30ce48fc-652b-4da7-b0d5-fa220fd837fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:37:43.226577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 531/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:37:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:37:43.561398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed099-ec43-43a3-a325-103407b49042 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:37:43.572675 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed099-ec43-43a3-a325-103407b49042 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:37:43.576118 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ce4ca-fa3b-427e-8d40-e65220cf788c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:37:43.576699 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce4ca-fa3b-427e-8d40-e65220cf788c service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:37:43.577011 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce4ca-fa3b-427e-8d40-e65220cf788c service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:37:43.577286 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce4ca-fa3b-427e-8d40-e65220cf788c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:37:43.586483 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ce4ca-fa3b-427e-8d40-e65220cf788c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:37:43.587905 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ce4ca-fa3b-427e-8d40-e65220cf788c service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:37:43.597624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 556/1087] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:37:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:37:53.213149 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=2 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:37:53.593010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=26 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:08.004394 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf4a34-83d6-464b-96a7-6afedba93371 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:08.004895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf4a34-83d6-464b-96a7-6afedba93371 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:08.004998 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf4a34-83d6-464b-96a7-6afedba93371 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:08.006328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 532/1088] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:08.012035 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c302c-cbf4-4797-a80c-103eb6262110 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:08.012482 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c302c-cbf4-4797-a80c-103eb6262110 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:08.012584 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c302c-cbf4-4797-a80c-103eb6262110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:08.031395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-517c302c-cbf4-4797-a80c-103eb6262110 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:08.032828 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-517c302c-cbf4-4797-a80c-103eb6262110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:08.041519 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 557/1089] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:08.432177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f142f3-b5fc-45c0-93ea-992187ef80d5 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:08.432532 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f142f3-b5fc-45c0-93ea-992187ef80d5 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:08.432831 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f142f3-b5fc-45c0-93ea-992187ef80d5 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:08.434161 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 533/1090] 10.222.0.16 () {54 vars in 966 bytes} [Sat Sep 10 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:08.439962 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df679-d0f9-4ea9-afea-7ba80b9e4d66 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:08.440239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df679-d0f9-4ea9-afea-7ba80b9e4d66 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:08.440508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df679-d0f9-4ea9-afea-7ba80b9e4d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:08.459922 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-ba6df679-d0f9-4ea9-afea-7ba80b9e4d66 None None] MFA Rules not processed for user `a2edea27275f4d75831629f1de22d43d`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:08.461177 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-ba6df679-d0f9-4ea9-afea-7ba80b9e4d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:08.467510 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 558/1091] 10.222.0.16 () {58 vars in 1063 bytes} [Sat Sep 10 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:08.474762 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f142f3-b5fc-45c0-93ea-992187ef80d5 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:08.485968 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f142f3-b5fc-45c0-93ea-992187ef80d5 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:08.490356 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad470eb9-fe53-4952-889e-3c1495dcbfc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2edea27275f4d75831629f1de22d43d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:08.491117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470eb9-fe53-4952-889e-3c1495dcbfc3 service glance] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:08.491449 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470eb9-fe53-4952-889e-3c1495dcbfc3 service glance] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:08.491702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad470eb9-fe53-4952-889e-3c1495dcbfc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:08.501585 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad470eb9-fe53-4952-889e-3c1495dcbfc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:08.503012 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad470eb9-fe53-4952-889e-3c1495dcbfc3 service glance] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:08.512111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 534/1092] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:38:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:38:10.960422 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677347dd-689e-474d-bd03-a28d75220a6c None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:10.961010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677347dd-689e-474d-bd03-a28d75220a6c None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:10.961010 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677347dd-689e-474d-bd03-a28d75220a6c None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:10.962352 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 559/1093] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:10.967624 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4644-1c9a-418c-9aa2-376d3b571857 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:10.968014 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4644-1c9a-418c-9aa2-376d3b571857 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:10.968167 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4644-1c9a-418c-9aa2-376d3b571857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:10.988405 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-c50e4644-1c9a-418c-9aa2-376d3b571857 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:10.989659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-c50e4644-1c9a-418c-9aa2-376d3b571857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:10.997389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 535/1094] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:11.327693 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677347dd-689e-474d-bd03-a28d75220a6c None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:11.339934 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677347dd-689e-474d-bd03-a28d75220a6c None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:11.344767 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:11.345369 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:11.345646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:11.345943 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:11.346560 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:11.348353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:38:11.348353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:38:11.348353 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:38:11.349505 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8414006-9572-435f-89f6-09c48a38de8b admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:11.367357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 560/1095] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 10 20:38:11 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:38:13.753540 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de603c8-3aac-4628-88be-618c7b8e652c None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:13.754071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de603c8-3aac-4628-88be-618c7b8e652c None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:13.754071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de603c8-3aac-4628-88be-618c7b8e652c None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:13.755403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 536/1096] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:13.760843 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586ed4e-115c-4d14-a1f7-b82b5e4d6127 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:13.761239 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586ed4e-115c-4d14-a1f7-b82b5e4d6127 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:13.761397 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586ed4e-115c-4d14-a1f7-b82b5e4d6127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:13.780671 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-e586ed4e-115c-4d14-a1f7-b82b5e4d6127 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:13.782508 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-e586ed4e-115c-4d14-a1f7-b82b5e4d6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:13.790561 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 561/1097] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:14.135389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de603c8-3aac-4628-88be-618c7b8e652c None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:14.149355 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de603c8-3aac-4628-88be-618c7b8e652c None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:14.154436 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22233-2f48-4058-8a43-3c5f930ef10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:14.155021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22233-2f48-4058-8a43-3c5f930ef10b service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:14.155318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22233-2f48-4058-8a43-3c5f930ef10b service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:14.155571 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22233-2f48-4058-8a43-3c5f930ef10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:14.164035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a22233-2f48-4058-8a43-3c5f930ef10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:14.165654 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a22233-2f48-4058-8a43-3c5f930ef10b service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:14.175286 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 537/1098] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:38:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:38:16.777812 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d4f8-d13c-47e0-81c6-29a85a6a2c60 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:16.778316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d4f8-d13c-47e0-81c6-29a85a6a2c60 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:16.778316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d4f8-d13c-47e0-81c6-29a85a6a2c60 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:16.779614 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 562/1099] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:16.784991 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a3748-c5a3-41b3-9b4b-2dc91cc5b780 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:16.785437 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a3748-c5a3-41b3-9b4b-2dc91cc5b780 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:16.785548 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a3748-c5a3-41b3-9b4b-2dc91cc5b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:16.804678 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-ac8a3748-c5a3-41b3-9b4b-2dc91cc5b780 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:16.805887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-ac8a3748-c5a3-41b3-9b4b-2dc91cc5b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:16.814472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 538/1100] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:17.159354 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d4f8-d13c-47e0-81c6-29a85a6a2c60 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:17.169903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d4f8-d13c-47e0-81c6-29a85a6a2c60 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:17.174097 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2a223-8bd6-40c0-bb5d-4694a06ade89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:17.174680 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a223-8bd6-40c0-bb5d-4694a06ade89 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:17.174960 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a223-8bd6-40c0-bb5d-4694a06ade89 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:17.175232 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a223-8bd6-40c0-bb5d-4694a06ade89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:17.183843 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2a223-8bd6-40c0-bb5d-4694a06ade89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:17.185316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2a223-8bd6-40c0-bb5d-4694a06ade89 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:17.195223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 563/1101] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:38:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:38:19.659028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e0af0-885c-4274-af62-65ba57692ea1 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:19.659473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e0af0-885c-4274-af62-65ba57692ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:19.659568 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e0af0-885c-4274-af62-65ba57692ea1 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:19.661064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 539/1102] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:19.666471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405605-656e-4e94-94e7-a2637b7374a4 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:19.666890 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405605-656e-4e94-94e7-a2637b7374a4 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:19.667022 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405605-656e-4e94-94e7-a2637b7374a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:19.687903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-af405605-656e-4e94-94e7-a2637b7374a4 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:19.689134 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-af405605-656e-4e94-94e7-a2637b7374a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:19.697271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 564/1103] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:20.033174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e0af0-885c-4274-af62-65ba57692ea1 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:20.043639 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e0af0-885c-4274-af62-65ba57692ea1 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:20.047365 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf643e7-0c98-4483-80bc-fe7343770e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:20.047965 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf643e7-0c98-4483-80bc-fe7343770e3e service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:20.048241 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf643e7-0c98-4483-80bc-fe7343770e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:20.048509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf643e7-0c98-4483-80bc-fe7343770e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:20.057443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf643e7-0c98-4483-80bc-fe7343770e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:20.058865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf643e7-0c98-4483-80bc-fe7343770e3e service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:20.068755 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 540/1104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:38:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:38:22.514622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718cc1-d1b3-4a75-b626-944f5a92a97a None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:22.515263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718cc1-d1b3-4a75-b626-944f5a92a97a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:22.515263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718cc1-d1b3-4a75-b626-944f5a92a97a None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:22.516540 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 565/1105] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:22.521594 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c9b3-6f03-4171-ae37-9e9e62989d25 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:22.521992 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c9b3-6f03-4171-ae37-9e9e62989d25 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:22.522221 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c9b3-6f03-4171-ae37-9e9e62989d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:22.541168 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-8179c9b3-6f03-4171-ae37-9e9e62989d25 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:22.542350 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-8179c9b3-6f03-4171-ae37-9e9e62989d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:22.550969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 541/1106] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:22.900319 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718cc1-d1b3-4a75-b626-944f5a92a97a None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:22.911251 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718cc1-d1b3-4a75-b626-944f5a92a97a None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:22.914760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a33c5-239c-4479-a9d8-b3c9917945a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:22.915342 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a33c5-239c-4479-a9d8-b3c9917945a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:22.915621 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a33c5-239c-4479-a9d8-b3c9917945a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:22.915892 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a33c5-239c-4479-a9d8-b3c9917945a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:22.925053 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a33c5-239c-4479-a9d8-b3c9917945a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:22.926475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a33c5-239c-4479-a9d8-b3c9917945a2 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:22.935568 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 566/1107] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:38:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:38:25.486611 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404490-3836-4b52-907e-f88c5b662999 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:25.487142 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404490-3836-4b52-907e-f88c5b662999 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:25.487264 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404490-3836-4b52-907e-f88c5b662999 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:25.488530 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 542/1108] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 10 20:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:38:25.493970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94110d-87f6-4d55-80c6-6e5b05fbff15 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:25.494362 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94110d-87f6-4d55-80c6-6e5b05fbff15 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:25.494521 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94110d-87f6-4d55-80c6-6e5b05fbff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:25.513741 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-af94110d-87f6-4d55-80c6-6e5b05fbff15 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:38:25.515539 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-af94110d-87f6-4d55-80c6-6e5b05fbff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:38:25.523191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 567/1109] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 10 20:38:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:38:25.865076 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404490-3836-4b52-907e-f88c5b662999 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:38:25.875800 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404490-3836-4b52-907e-f88c5b662999 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:38:25.879242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c5c73-4f80-4820-92b3-a3e8ad900ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:38:25.879833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c5c73-4f80-4820-92b3-a3e8ad900ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:38:25.880112 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c5c73-4f80-4820-92b3-a3e8ad900ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:38:25.880384 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c5c73-4f80-4820-92b3-a3e8ad900ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:38:25.889469 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c5c73-4f80-4820-92b3-a3e8ad900ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:38:25.891894 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c5c73-4f80-4820-92b3-a3e8ad900ce7 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:38:25.902003 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 543/1110] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:38:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:38:35.508862 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=33 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:35.897933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=33 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:48.243488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.244069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.244069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.262997 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:39:48.264200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:48.271925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 568/1111] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:39:48.280255 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.280753 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.280882 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.300133 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:39:48.301341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:48.309232 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 544/1112] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:39:48.313578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.323318 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9a7dc-1769-499a-be31-17116d4aeb21 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.327785 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.328371 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.328650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.328962 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.329593 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:39:48.329895 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.330903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.330903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:39:48.330903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:39:48.331789 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.343381 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 569/1113] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 10 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:39:48.351201 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.360691 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8109a5c-7cd5-491f-ae8d-291f9c6d4a6a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.365570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.366144 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.366419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.366685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.367302 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.369093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.369093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:39:48.369093 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:39:48.370283 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.397721 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 545/1114] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 10 20:39:48 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:39:48.402326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.411936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aabd14-c5e8-4a9b-bd7d-8a6ae40c23d8 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.468263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.468919 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.469206 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.469487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.470132 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.471142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.471142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:39:48.471142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:39:48.472360 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.497459 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 570/1115] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:39:48 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:39:48.501782 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.512857 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0a604-4dc2-4a1c-8530-1f487e83672d admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.517409 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.517999 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.518279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.518551 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.519184 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.520187 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.520187 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:39:48.520187 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:39:48.521102 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.533605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 546/1116] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:39:48.537622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.547477 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513696d-548b-4c75-95c9-a8c0e853fe08 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.552140 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.552730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.553054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.553326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.553955 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.554958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.554958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:39:48.554958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:39:48.555837 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4dd35-ebbb-4f60-ac15-4e565388b987 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.569730 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 571/1117] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:39:48.574331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.584101 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edaf54-e888-4989-83a6-1ec7de4e90df admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.588618 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.589282 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.589561 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.589833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] PATH_INFO: `/v3/projects/efb4b6216ccf47b5b4422d21b7f5a9ce/users/31d02df02178459391c32f3d2b9c6d0d/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.604310 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb4b6216ccf47b5b4422d21b7f5a9ce, user_id=31d02df02178459391c32f3d2b9c6d0d, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.605414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.605414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:39:48.605414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:39:48.607331 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30b1e-ce60-4c1f-986e-d39182970dcf admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.621405 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 547/1118] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:39:48 2022] PUT /identity/v3/projects/efb4b6216ccf47b5b4422d21b7f5a9ce/users/31d02df02178459391c32f3d2b9c6d0d/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:39:48.633403 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8139f4-3e2f-43b9-8982-ee5dff969674 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.633690 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8139f4-3e2f-43b9-8982-ee5dff969674 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.633964 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8139f4-3e2f-43b9-8982-ee5dff969674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.662090 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2a8139f4-3e2f-43b9-8982-ee5dff969674 None None] MFA Rules not processed for user `31d02df02178459391c32f3d2b9c6d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:39:48.663290 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2a8139f4-3e2f-43b9-8982-ee5dff969674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:48.727764 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 572/1119] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:39:48.742172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d219-4deb-4cfa-837b-98222bf4c3dc None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.742456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d219-4deb-4cfa-837b-98222bf4c3dc None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.742727 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d219-4deb-4cfa-837b-98222bf4c3dc None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.744090 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 548/1120] 10.222.0.16 () {54 vars in 964 bytes} [Sat Sep 10 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:39:48.749731 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b236f-f633-4586-9d4a-d9d0b6532ef6 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.749957 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b236f-f633-4586-9d4a-d9d0b6532ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.750229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b236f-f633-4586-9d4a-d9d0b6532ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.773766 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-a96b236f-f633-4586-9d4a-d9d0b6532ef6 None None] MFA Rules not processed for user `6fbd946e624a40a5ba757daa22cec6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:39:48.774999 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-a96b236f-f633-4586-9d4a-d9d0b6532ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:48.819746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:48.827672 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 573/1121] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Sep 10 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:39:48.835408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d219-4deb-4cfa-837b-98222bf4c3dc None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.845869 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d219-4deb-4cfa-837b-98222bf4c3dc None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.849366 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd946e624a40a5ba757daa22cec6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.849949 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.850256 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.850599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.859764 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.861270 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:48.870735 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 549/1122] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:39:48 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:48.908685 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d938-bb7f-4dd0-9584-6df713ea3dbf None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.909050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d938-bb7f-4dd0-9584-6df713ea3dbf None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.909328 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d938-bb7f-4dd0-9584-6df713ea3dbf None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.910565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 574/1123] 10.222.0.16 () {52 vars in 830 bytes} [Sat Sep 10 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:39:48.914095 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:48.975092 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddb4d8-eaf2-41aa-953a-992b807febe5 service cinder] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:48.980430 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:48.981094 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:48.981375 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:48.981646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] PATH_INFO: `/v3/users/31d02df02178459391c32f3d2b9c6d0d` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:48.982806 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d02df02178459391c32f3d2b9c6d0d)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:48.983829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:48.983829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:39:48.983829 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:39:48.985086 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:49.052659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d02df02178459391c32f3d2b9c6d0d'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.053351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d02df02178459391c32f3d2b9c6d0d'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.062059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d02df02178459391c32f3d2b9c6d0d'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.062722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d02df02178459391c32f3d2b9c6d0d'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.085354 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d02df02178459391c32f3d2b9c6d0d'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.105561 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 550/1124] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 10 20:39:48 2022] DELETE /identity/v3/users/31d02df02178459391c32f3d2b9c6d0d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:39:49.109948 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:49.110226 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:49.110512 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:49.129643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:39:49.130865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:49.188448 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 575/1125] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:39:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:39:49.199058 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:49.200460 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:49.205698 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:49.259708 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02a12-c626-48d2-8877-f7732f6df7f6 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:49.263307 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeeffe-63b8-4f43-9c11-9ef486977074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:49.263902 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeeffe-63b8-4f43-9c11-9ef486977074 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:49.264175 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeeffe-63b8-4f43-9c11-9ef486977074 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:49.264443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeeffe-63b8-4f43-9c11-9ef486977074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:49.273117 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeeffe-63b8-4f43-9c11-9ef486977074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:49.274543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeeffe-63b8-4f43-9c11-9ef486977074 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:49.284097 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 551/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:39:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:49.636058 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:39:49.640976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:39:49.650397 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78ffa-2e50-4240-aa8e-92b3d8ad9186 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:39:49.655874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:39:49.656527 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:39:49.656696 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:39:49.657179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] PATH_INFO: `/v3/projects/efb4b6216ccf47b5b4422d21b7f5a9ce` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:39:49.658414 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb4b6216ccf47b5b4422d21b7f5a9ce)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:39:49.659488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:39:49.659488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:39:49.659488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:39:49.660635 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:39:49.730363 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb4b6216ccf47b5b4422d21b7f5a9ce', 'request_id': 'req-28d7d296-ba81-44a5-8d9d-33897a0e2962'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.743271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb4b6216ccf47b5b4422d21b7f5a9ce', 'request_id': 'req-28d7d296-ba81-44a5-8d9d-33897a0e2962'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.753779 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb4b6216ccf47b5b4422d21b7f5a9ce', 'request_id': 'req-28d7d296-ba81-44a5-8d9d-33897a0e2962'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.765047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] The token cache is being invalidate because project efb4b6216ccf47b5b4422d21b7f5a9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 10 20:39:49.765345 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.766047 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-28d7d296-ba81-44a5-8d9d-33897a0e2962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:39:49.767548 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 576/1127] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 10 20:39:49 2022] DELETE /identity/v3/projects/efb4b6216ccf47b5b4422d21b7f5a9ce => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:39:59.280152 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=25 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:59.762145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:41:11.632877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d377-dca9-47b6-9e7d-609a4a962f1a None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:11.633473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d377-dca9-47b6-9e7d-609a4a962f1a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:11.633473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d377-dca9-47b6-9e7d-609a4a962f1a None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:11.634771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 552/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:11.639728 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeed24-153b-4d4a-91fd-98f3e85bf623 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:11.640169 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeed24-153b-4d4a-91fd-98f3e85bf623 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:11.640278 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeed24-153b-4d4a-91fd-98f3e85bf623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:11.705912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-a8aeed24-153b-4d4a-91fd-98f3e85bf623 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:11.707094 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-a8aeed24-153b-4d4a-91fd-98f3e85bf623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:11.798532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 577/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:41:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:11.961758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d377-dca9-47b6-9e7d-609a4a962f1a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:11.963463 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-0d33d377-dca9-47b6-9e7d-609a4a962f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:12.051185 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d377-dca9-47b6-9e7d-609a4a962f1a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:12.056579 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500431c-6d17-4140-b061-e515742ec28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:12.057205 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500431c-6d17-4140-b061-e515742ec28c service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:12.057493 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500431c-6d17-4140-b061-e515742ec28c service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:12.057767 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500431c-6d17-4140-b061-e515742ec28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:12.065957 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500431c-6d17-4140-b061-e515742ec28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:12.067539 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500431c-6d17-4140-b061-e515742ec28c service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:12.077242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 553/1130] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:13.698497 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb8d4-1223-496e-9ab9-ab47201095bc None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:13.699059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb8d4-1223-496e-9ab9-ab47201095bc None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:13.699059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb8d4-1223-496e-9ab9-ab47201095bc None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:13.700288 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 578/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:13.705090 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681070-eaee-4dbe-8b4c-d5e80712795a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:13.705534 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681070-eaee-4dbe-8b4c-d5e80712795a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:13.705634 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681070-eaee-4dbe-8b4c-d5e80712795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:13.725781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-d1681070-eaee-4dbe-8b4c-d5e80712795a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:13.727001 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-d1681070-eaee-4dbe-8b4c-d5e80712795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:13.734788 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 554/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:13.892868 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb8d4-1223-496e-9ab9-ab47201095bc None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:13.908027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb8d4-1223-496e-9ab9-ab47201095bc None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:13.915063 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e6d63-7775-42a5-b773-efde7e003f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:13.915790 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6d63-7775-42a5-b773-efde7e003f26 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:13.916074 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6d63-7775-42a5-b773-efde7e003f26 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:13.916423 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6d63-7775-42a5-b773-efde7e003f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:13.925566 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e6d63-7775-42a5-b773-efde7e003f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:13.927159 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e6d63-7775-42a5-b773-efde7e003f26 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:13.936954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 579/1133] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:16.933544 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1d055-d83d-44f3-8237-ece27abff28f None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:16.934064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1d055-d83d-44f3-8237-ece27abff28f None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:16.934064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1d055-d83d-44f3-8237-ece27abff28f None None] PATH_INFO: `/v3` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:16.935297 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 555/1134] 10.222.0.42 () {54 vars in 925 bytes} [Sat Sep 10 20:41:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 10 20:41:16.964876 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccef9-b69e-476f-9f5d-599cb2376ffd None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:16.965339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccef9-b69e-476f-9f5d-599cb2376ffd None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:16.965466 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccef9-b69e-476f-9f5d-599cb2376ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:16.998509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-c08ccef9-b69e-476f-9f5d-599cb2376ffd None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:16.999703 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-c08ccef9-b69e-476f-9f5d-599cb2376ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:17.052518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:41:17.062760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 580/1135] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Sep 10 20:41:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:20.786833 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc58275-6108-4f23-8410-d4c678bac150 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:20.787237 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc58275-6108-4f23-8410-d4c678bac150 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:20.787382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc58275-6108-4f23-8410-d4c678bac150 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:20.788722 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 556/1136] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 10 20:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:20.793769 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e5d4-1fd2-415a-8439-f36cc158129d None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:20.794233 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e5d4-1fd2-415a-8439-f36cc158129d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:20.794332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e5d4-1fd2-415a-8439-f36cc158129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:20.816626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-61d0e5d4-1fd2-415a-8439-f36cc158129d None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:20.818404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-61d0e5d4-1fd2-415a-8439-f36cc158129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:20.830473 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 581/1137] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 10 20:41:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:20.838438 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc58275-6108-4f23-8410-d4c678bac150 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:20.851653 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc58275-6108-4f23-8410-d4c678bac150 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:20.856562 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df1e74-4b20-46d7-af45-4055e032bf35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:20.857180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1e74-4b20-46d7-af45-4055e032bf35 service placement] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:20.857458 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1e74-4b20-46d7-af45-4055e032bf35 service placement] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:20.857727 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1e74-4b20-46d7-af45-4055e032bf35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:20.866316 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df1e74-4b20-46d7-af45-4055e032bf35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:20.867893 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df1e74-4b20-46d7-af45-4055e032bf35 service placement] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:20.877382 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 557/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:25.966061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7b201-e34a-46dd-90e9-632091d2f361 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:25.966623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7b201-e34a-46dd-90e9-632091d2f361 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:25.966623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7b201-e34a-46dd-90e9-632091d2f361 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:25.968050 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 582/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:25.972933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00eba-118c-4d86-a924-f5ff0bacd096 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:25.973341 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00eba-118c-4d86-a924-f5ff0bacd096 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:25.973475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00eba-118c-4d86-a924-f5ff0bacd096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:25.993725 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-0be00eba-118c-4d86-a924-f5ff0bacd096 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:25.994917 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-0be00eba-118c-4d86-a924-f5ff0bacd096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:26.003552 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 558/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:41:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:26.161760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7b201-e34a-46dd-90e9-632091d2f361 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:26.175317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7b201-e34a-46dd-90e9-632091d2f361 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:26.181116 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ea9d7-c0c6-4392-a836-7303d7967db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:26.181707 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ea9d7-c0c6-4392-a836-7303d7967db6 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:26.181987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ea9d7-c0c6-4392-a836-7303d7967db6 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:26.182264 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ea9d7-c0c6-4392-a836-7303d7967db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:26.193896 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ea9d7-c0c6-4392-a836-7303d7967db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:26.195739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ea9d7-c0c6-4392-a836-7303d7967db6 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:26.206718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 583/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:27.819605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fe59-073b-4b93-9d3c-9bbd3eddb539 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:27.820193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fe59-073b-4b93-9d3c-9bbd3eddb539 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:27.820193 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fe59-073b-4b93-9d3c-9bbd3eddb539 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:27.821550 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 559/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 10 20:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:27.826183 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4c89b-389f-458c-b941-4e6d8f216635 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:27.826624 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4c89b-389f-458c-b941-4e6d8f216635 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:27.826741 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4c89b-389f-458c-b941-4e6d8f216635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:27.848670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-bfa4c89b-389f-458c-b941-4e6d8f216635 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:27.850520 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-bfa4c89b-389f-458c-b941-4e6d8f216635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:27.858287 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 584/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 10 20:41:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:28.020045 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fe59-073b-4b93-9d3c-9bbd3eddb539 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:28.034087 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fe59-073b-4b93-9d3c-9bbd3eddb539 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:28.039074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b75c-daf9-41b7-9463-647ac535b0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:28.039661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b75c-daf9-41b7-9463-647ac535b0a5 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:28.039941 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b75c-daf9-41b7-9463-647ac535b0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:28.040213 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b75c-daf9-41b7-9463-647ac535b0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:28.049509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b75c-daf9-41b7-9463-647ac535b0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:28.051082 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b75c-daf9-41b7-9463-647ac535b0a5 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:28.061192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 560/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:32.429805 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb2a4-71f8-4680-a2da-83a4c504ce61 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:32.430339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb2a4-71f8-4680-a2da-83a4c504ce61 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:32.430339 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefb2a4-71f8-4680-a2da-83a4c504ce61 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:32.431655 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 585/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:32.436720 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af70ea-5231-41bc-84f5-99e997e9d09c None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:32.437407 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af70ea-5231-41bc-84f5-99e997e9d09c None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:32.437523 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af70ea-5231-41bc-84f5-99e997e9d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:32.457037 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-26af70ea-5231-41bc-84f5-99e997e9d09c None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:32.458218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-26af70ea-5231-41bc-84f5-99e997e9d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:32.466388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 561/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:41:32.808530 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefb2a4-71f8-4680-a2da-83a4c504ce61 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:32.810309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-adefb2a4-71f8-4680-a2da-83a4c504ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:32.868156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefb2a4-71f8-4680-a2da-83a4c504ce61 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:32.871927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba22f-f66e-4c6b-8ee8-209b41a9ff0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:32.872526 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba22f-f66e-4c6b-8ee8-209b41a9ff0d service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:32.872837 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba22f-f66e-4c6b-8ee8-209b41a9ff0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:32.873103 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba22f-f66e-4c6b-8ee8-209b41a9ff0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:32.882605 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dba22f-f66e-4c6b-8ee8-209b41a9ff0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:32.884057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dba22f-f66e-4c6b-8ee8-209b41a9ff0d service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:32.893262 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 586/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:35.270328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215031f4-9f41-42c1-b051-3efef909ee72 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:35.271349 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215031f4-9f41-42c1-b051-3efef909ee72 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:35.271349 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215031f4-9f41-42c1-b051-3efef909ee72 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:35.272694 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 562/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:35.277950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f11d83-1bf6-40e4-979a-0152ee0bed4a None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:35.278365 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f11d83-1bf6-40e4-979a-0152ee0bed4a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:35.278482 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f11d83-1bf6-40e4-979a-0152ee0bed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:35.297979 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-48f11d83-1bf6-40e4-979a-0152ee0bed4a None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:35.299167 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-48f11d83-1bf6-40e4-979a-0152ee0bed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:35.306926 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 587/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:35.646667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215031f4-9f41-42c1-b051-3efef909ee72 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:35.657547 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215031f4-9f41-42c1-b051-3efef909ee72 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:35.661022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bd781-61b9-4489-9a2c-5a91dce232b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:35.661637 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bd781-61b9-4489-9a2c-5a91dce232b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:35.661916 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bd781-61b9-4489-9a2c-5a91dce232b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:35.662190 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bd781-61b9-4489-9a2c-5a91dce232b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:35.670827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bd781-61b9-4489-9a2c-5a91dce232b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:35.672258 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bd781-61b9-4489-9a2c-5a91dce232b0 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:35.681361 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 563/1150] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:39.712718 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c6b7-be6e-410f-870f-0920a1acea6b None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:39.713286 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c6b7-be6e-410f-870f-0920a1acea6b None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:39.713286 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c6b7-be6e-410f-870f-0920a1acea6b None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:39.714625 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 588/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:39.719856 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79ece-5f61-4d24-98ff-fb5627d4951d None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:39.720300 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79ece-5f61-4d24-98ff-fb5627d4951d None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:39.720396 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79ece-5f61-4d24-98ff-fb5627d4951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:39.728604 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=67 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:41:39.741463 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-d7a79ece-5f61-4d24-98ff-fb5627d4951d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:39.742646 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-d7a79ece-5f61-4d24-98ff-fb5627d4951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:39.750330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 564/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:41:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:40.101697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782c6b7-be6e-410f-870f-0920a1acea6b None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:40.103393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-8782c6b7-be6e-410f-870f-0920a1acea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:40.171249 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782c6b7-be6e-410f-870f-0920a1acea6b None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:40.174776 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95574cd8-bbc5-4d20-b58a-e99cb4f3cd67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd946e624a40a5ba757daa22cec6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:40.175368 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95574cd8-bbc5-4d20-b58a-e99cb4f3cd67 service cinder] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:40.175650 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95574cd8-bbc5-4d20-b58a-e99cb4f3cd67 service cinder] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:40.175927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95574cd8-bbc5-4d20-b58a-e99cb4f3cd67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:40.184633 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95574cd8-bbc5-4d20-b58a-e99cb4f3cd67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:40.186083 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95574cd8-bbc5-4d20-b58a-e99cb4f3cd67 service cinder] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:40.195927 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 589/1153] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:42.567207 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a132a-f344-444d-ad70-8ad43524a541 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:42.567741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a132a-f344-444d-ad70-8ad43524a541 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:42.567741 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a132a-f344-444d-ad70-8ad43524a541 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:42.569125 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 565/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 10 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:41:42.574369 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f367-b4eb-427b-90da-9ca490a88c46 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:42.574788 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f367-b4eb-427b-90da-9ca490a88c46 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:42.574922 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f367-b4eb-427b-90da-9ca490a88c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:42.594727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-5e06f367-b4eb-427b-90da-9ca490a88c46 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:41:42.595935 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-5e06f367-b4eb-427b-90da-9ca490a88c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:42.604227 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 590/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 10 20:41:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:41:42.953997 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a132a-f344-444d-ad70-8ad43524a541 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:41:42.955645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-371a132a-f344-444d-ad70-8ad43524a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:41:42.969172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a132a-f344-444d-ad70-8ad43524a541 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:41:42.972577 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233af5-00ab-4002-9b8f-f5b9d0ece2ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbd946e624a40a5ba757daa22cec6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:41:42.973194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233af5-00ab-4002-9b8f-f5b9d0ece2ff service cinder] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:41:42.973467 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233af5-00ab-4002-9b8f-f5b9d0ece2ff service cinder] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:41:42.973734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233af5-00ab-4002-9b8f-f5b9d0ece2ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:41:42.982935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233af5-00ab-4002-9b8f-f5b9d0ece2ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:41:42.984489 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233af5-00ab-4002-9b8f-f5b9d0ece2ff service cinder] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:41:42.994280 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 566/1156] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:41:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:41:52.589856 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=75 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:41:52.989895 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=8 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:42:56.725358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03630-800b-4da0-af10-daae9ec80d36 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.725978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03630-800b-4da0-af10-daae9ec80d36 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.725978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03630-800b-4da0-af10-daae9ec80d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.727565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35bc45-546c-4c5d-809c-4916c38dd2f0 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.727999 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35bc45-546c-4c5d-809c-4916c38dd2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.728120 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35bc45-546c-4c5d-809c-4916c38dd2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.749295 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-69a03630-800b-4da0-af10-daae9ec80d36 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:42:56.751057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-69a03630-800b-4da0-af10-daae9ec80d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:56.755704 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-5b35bc45-546c-4c5d-809c-4916c38dd2f0 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:42:56.757685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-5b35bc45-546c-4c5d-809c-4916c38dd2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:56.760172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 591/1157] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:42:56.769064 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 567/1158] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:42:56.769245 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.769588 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.769936 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.780519 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.781083 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.781544 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.791773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:42:56.793014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:56.801329 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 592/1159] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:42:56.802600 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:42:56.803767 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:56.805970 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:56.811731 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 568/1160] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:42:56.816620 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:56.819178 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30292c50-ac45-4392-ab72-fd5290aa5971 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:56.824024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:56.824608 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.824923 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.825193 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] PATH_INFO: `/v3/domains` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.825418 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e8bdf-8021-4847-8c7d-b06abcee5896 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:56.825819 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:42:56.826122 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:56.827697 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:56.829921 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:56.830487 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.830765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.831033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] PATH_INFO: `/v3/domains` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.831650 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 10 20:42:56.831946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:56.833033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:42:56.833033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:42:56.833033 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:42:56.833899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:56.845349 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 593/1161] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 10 20:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:42:56.845525 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 569/1162] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 10 20:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 10 20:42:56.847856 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:56.852946 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:56.857413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08ea44-47a0-401d-b65e-979faf5adb1f admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:56.862954 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:56.863447 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacb737-0f0b-4c9e-9f58-a5605ba9e355 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:56.863563 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.863793 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.864094 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.864717 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:56.865747 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:42:56.865747 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:42:56.865747 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:42:56.866925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:56.868539 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:56.869144 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.869516 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.869788 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.870397 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:56.872330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:56.905158 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 594/1163] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:42:56.909101 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:56.912677 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 570/1164] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:42:56.913570 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:56.975014 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85338c09-c171-44c8-93e9-ab2b258afc50 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:56.977661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9019a6-ab49-4950-928b-e771059cac60 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:56.980024 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:56.980632 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.980944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.981221 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.981850 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:56.982662 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:56.983255 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:56.983537 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:56.983803 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:56.983921 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:56.984980 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:56.985990 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:42:56.985990 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:42:56.985990 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:42:56.987197 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.008145 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 595/1165] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:42:57.009279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 571/1166] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:42:56 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:42:57.012357 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.012994 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.022144 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c71b-70e6-4c10-bb3d-fb94e4183b62 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.022861 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9943a-df38-46c5-8f51-da37b4469830 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.027155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.027575 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.027796 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.028104 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.028209 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.028375 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.028472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.028667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.029177 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.029318 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.030781 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.030899 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.043687 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 596/1167] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:42:57.043875 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 572/1168] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:42:57.044755 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.045028 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.054673 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5db03-01e0-4c1f-a22d-812e3892e3c0 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.055813 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8192-ee4a-44b7-a687-3ef9a62821a3 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.059231 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.060048 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.060326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.060593 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.060765 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.061242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.061373 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.061657 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.061932 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.063191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.063356 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.064935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.073575 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 597/1169] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:42:57.076482 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 573/1170] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:42:57.077449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.079560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.086944 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f150-28e0-4d88-9a53-62b4e99173b9 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.089186 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939a30a-257c-427f-abbe-2b29b3e08ee3 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.091512 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.092139 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.092420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.092684 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] PATH_INFO: `/v3/projects/9d44d875c1b04e9f847fec2f5a5cd958/users/055696859261472eae40adbd97fcd20c/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.093782 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f2551-29d7-4863-820c-3b61c1bf6cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.094420 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f2551-29d7-4863-820c-3b61c1bf6cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.094702 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f2551-29d7-4863-820c-3b61c1bf6cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.094974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f2551-29d7-4863-820c-3b61c1bf6cbb admin admin] PATH_INFO: `/v3/projects/491bef33ceda46298fc983cc5a83aa44/users/4d39d92aa3594305a40dc6c77abc69cf/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.106745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d44d875c1b04e9f847fec2f5a5cd958, user_id=055696859261472eae40adbd97fcd20c, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.107760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:42:57.107760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:42:57.107760 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:42:57.110309 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057165e-2278-40e1-832f-9ef81da4d81f admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.110443 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f2551-29d7-4863-820c-3b61c1bf6cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=491bef33ceda46298fc983cc5a83aa44, user_id=4d39d92aa3594305a40dc6c77abc69cf, role_id=d761e03bbfeb4c19b3d4c3290cbc0cc4)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.113030 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f2551-29d7-4863-820c-3b61c1bf6cbb admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.122818 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 598/1171] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:42:57 2022] PUT /identity/v3/projects/9d44d875c1b04e9f847fec2f5a5cd958/users/055696859261472eae40adbd97fcd20c/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 10 20:42:57.125881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 574/1172] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:42:57 2022] PUT /identity/v3/projects/491bef33ceda46298fc983cc5a83aa44/users/4d39d92aa3594305a40dc6c77abc69cf/roles/d761e03bbfeb4c19b3d4c3290cbc0cc4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 10 20:42:57.127950 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.128229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.128502 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.130846 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.131136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.131410 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.147291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:42:57.148494 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:57.151121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] MFA Rules not processed for user `4896c73f97d94602afe7ed8c9d748471`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:42:57.152266 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:57.190041 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:42:57.193230 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:42:57.210325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 599/1173] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:42:57.212442 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 575/1174] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:42:57.220297 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.222301 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:42:57.223619 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:42:57.273805 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff3c1c-c9e2-4f71-95e0-7edbf6c76e3d None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.277437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c00a93-26a5-4032-8213-09bcb7170c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.278027 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c00a93-26a5-4032-8213-09bcb7170c82 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.278301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c00a93-26a5-4032-8213-09bcb7170c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.278567 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c00a93-26a5-4032-8213-09bcb7170c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.287325 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c00a93-26a5-4032-8213-09bcb7170c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.288737 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c00a93-26a5-4032-8213-09bcb7170c82 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.289607 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f794f9f-4998-48e2-a4ab-2cbd7c0bd5b8 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:42:57.293175 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0cdb5-1080-4b45-9fb3-f36b1a22ae87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:42:57.293762 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0cdb5-1080-4b45-9fb3-f36b1a22ae87 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:42:57.294044 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0cdb5-1080-4b45-9fb3-f36b1a22ae87 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:42:57.294313 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0cdb5-1080-4b45-9fb3-f36b1a22ae87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:42:57.298283 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 600/1175] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:42:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:42:57.303279 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0cdb5-1080-4b45-9fb3-f36b1a22ae87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:42:57.304706 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0cdb5-1080-4b45-9fb3-f36b1a22ae87 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:42:57.314967 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 576/1176] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:42:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:43:02.661945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:02.662551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:02.662551 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:02.710844 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:02.712404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:02.780515 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:02.781070 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:02.781174 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:02.824595 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] MFA Rules not processed for user `4d39d92aa3594305a40dc6c77abc69cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:02.826194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:02.828724 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 601/1177] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:02.833222 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:02.845604 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e1d30-45fa-4ee5-bc17-2d797893ea3a None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:02.851978 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:02.852922 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:02.853308 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:02.853691 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] PATH_INFO: `/v3/projects` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:02.854601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:02.857055 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:02.921989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 602/1178] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 10 20:43:02 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:43:02.926270 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:02.973132 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 577/1179] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:02.974644 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:02.995175 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97db4f-1fca-4149-beab-bc7654a83e04 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.036958 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:03.041411 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54331e-a6d1-43c3-9db0-4efde58dc919 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.049277 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.050225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.051069 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.051644 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.052985 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.055311 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.087001 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 603/1180] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:43:02 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:43:03.091727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.092819 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.093510 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.093793 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.094066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.094715 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.096680 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.111420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dda092-1e5b-4344-af9c-b76d307088b9 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.117393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.118336 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.118336 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.118543 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.119203 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.119779 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:03.122429 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.141877 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 604/1181] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:43:03.143055 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.150271 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 578/1182] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 10 20:43:02 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 10 20:43:03.151752 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.154884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19af2b-d6e2-4f85-90f4-07b0d28f6e3b admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.231248 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.231918 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.232200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.232488 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] PATH_INFO: `/v3/projects/d2893eee1a864fb88f3749062308703b/users/0a9cef3a2e2947bdbfe8097d1538107f/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.242098 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430a4a-acae-4194-8f7f-daf93d025c50 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.247909 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.248253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2893eee1a864fb88f3749062308703b, user_id=0a9cef3a2e2947bdbfe8097d1538107f, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.249949 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.250236 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.250505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] PATH_INFO: `/v3/users` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.251130 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.251469 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.253260 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.275610 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 605/1183] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:43:03 2022] PUT /identity/v3/projects/d2893eee1a864fb88f3749062308703b/users/0a9cef3a2e2947bdbfe8097d1538107f/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:43:03.279392 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.281419 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 579/1184] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 10 20:43:03 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 10 20:43:03.285784 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.297131 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172db6b-eeda-4fee-afc8-9578b58f20d2 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.348179 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96d7c2-07d0-4547-97e9-47daf2682241 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.354387 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.355797 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.356142 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.356449 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.357156 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.358746 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.368952 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.369688 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.370055 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.370383 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] PATH_INFO: `/v3/roles` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.371088 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.375784 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.375959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 606/1185] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:43:03.377312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.388573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 580/1186] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 10 20:43:03.390757 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.393917 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccee3a-0bb4-466a-98df-930eb8a2fae9 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.399629 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.400372 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.400901 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.401261 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] PATH_INFO: `/v3/projects/d2893eee1a864fb88f3749062308703b/users/0a9cef3a2e2947bdbfe8097d1538107f/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.401782 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620826-d7b3-4f93-8ba2-effeb9fa1464 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.403404 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2893eee1a864fb88f3749062308703b, user_id=0a9cef3a2e2947bdbfe8097d1538107f, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.406565 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.407146 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.408059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.408667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.408901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] PATH_INFO: `/v3/projects/8eb24758ee2c4c9088a697fc267dd79a/users/5ecfa461a8b940a586362d8988787ec1/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.420623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 607/1187] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:43:03 2022] PUT /identity/v3/projects/d2893eee1a864fb88f3749062308703b/users/0a9cef3a2e2947bdbfe8097d1538107f/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:43:03.449156 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb24758ee2c4c9088a697fc267dd79a, user_id=5ecfa461a8b940a586362d8988787ec1, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.451969 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.475747 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 581/1188] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:43:03 2022] PUT /identity/v3/projects/8eb24758ee2c4c9088a697fc267dd79a/users/5ecfa461a8b940a586362d8988787ec1/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:43:03.476761 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.533662 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:03.556115 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2bce7-14f9-40e5-a720-95481f9ebf64 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.644662 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd9444-154e-43a3-b2f8-28e6d76d0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.652271 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9444-154e-43a3-b2f8-28e6d76d0ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.652609 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9444-154e-43a3-b2f8-28e6d76d0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.653059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9444-154e-43a3-b2f8-28e6d76d0ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.653913 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd9444-154e-43a3-b2f8-28e6d76d0ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.657102 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd9444-154e-43a3-b2f8-28e6d76d0ff7 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.674187 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 608/1189] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 10 20:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 10 20:43:03.678121 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:03.694751 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f046-b796-4e2b-9a99-b9507d117770 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:03.706935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:03.707769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:03.708155 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:03.708560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] PATH_INFO: `/v3/projects/8eb24758ee2c4c9088a697fc267dd79a/users/5ecfa461a8b940a586362d8988787ec1/roles/ad5067901a144373a35aac9ba7bf4722` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:03.710852 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb24758ee2c4c9088a697fc267dd79a, user_id=5ecfa461a8b940a586362d8988787ec1, role_id=ad5067901a144373a35aac9ba7bf4722)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:03.713642 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:03.726770 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 582/1190] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 10 20:43:03 2022] PUT /identity/v3/projects/8eb24758ee2c4c9088a697fc267dd79a/users/5ecfa461a8b940a586362d8988787ec1/roles/ad5067901a144373a35aac9ba7bf4722 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:43:10.814228 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1d57-6761-4c3e-933d-160e2cdb5e69 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:10.814745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1d57-6761-4c3e-933d-160e2cdb5e69 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:10.814745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1d57-6761-4c3e-933d-160e2cdb5e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:10.859378 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-0ead1d57-6761-4c3e-933d-160e2cdb5e69 None None] MFA Rules not processed for user `0a9cef3a2e2947bdbfe8097d1538107f`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:10.861276 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-0ead1d57-6761-4c3e-933d-160e2cdb5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:11.006105 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 609/1191] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:43:10 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:43:11.021744 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:11.023518 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:11.118445 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:11.147328 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f463-fdeb-4416-907c-5b2fe9b1dba8 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:11.152602 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2edea27275f4d75831629f1de22d43d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:11.153475 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:11.163901 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:11.164452 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:11.260472 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:11.262008 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:11.277074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 583/1192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:11 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:11.280057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2c2cd-3c94-4a75-ab17-6883a4fe43b5 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:11.280326 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2c2cd-3c94-4a75-ab17-6883a4fe43b5 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:11.280593 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2c2cd-3c94-4a75-ab17-6883a4fe43b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:11.309747 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-cdd2c2cd-3c94-4a75-ab17-6883a4fe43b5 None None] MFA Rules not processed for user `5ecfa461a8b940a586362d8988787ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:11.310945 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-cdd2c2cd-3c94-4a75-ab17-6883a4fe43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:11.376291 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=100 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:11.388929 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 610/1193] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:43:11 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:11.399900 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:11.401434 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:11.416531 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ac9b6-e5e9-44fe-b647-a9e4095d3673 service glance] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:11.421481 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f3e29-ded8-4f8c-945d-712c0d203aec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2edea27275f4d75831629f1de22d43d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:11.422108 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f3e29-ded8-4f8c-945d-712c0d203aec service glance] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:11.422393 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f3e29-ded8-4f8c-945d-712c0d203aec service glance] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:11.422826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f3e29-ded8-4f8c-945d-712c0d203aec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:11.484877 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f3e29-ded8-4f8c-945d-712c0d203aec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:11.486327 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f3e29-ded8-4f8c-945d-712c0d203aec service glance] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:11.495695 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 584/1194] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:11 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:19.664622 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9be4ae-7bb1-43f9-8af9-a67ed2372f57 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:19.665393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9be4ae-7bb1-43f9-8af9-a67ed2372f57 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:19.665393 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9be4ae-7bb1-43f9-8af9-a67ed2372f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:19.686773 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-2a9be4ae-7bb1-43f9-8af9-a67ed2372f57 None None] MFA Rules not processed for user `4d39d92aa3594305a40dc6c77abc69cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:19.688195 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-2a9be4ae-7bb1-43f9-8af9-a67ed2372f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:19.710989 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 611/1195] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:43:19 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:20.035710 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c42d9-3e4b-4cb3-974e-4bef80f2d1ce None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.036269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c42d9-3e4b-4cb3-974e-4bef80f2d1ce None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.036269 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c42d9-3e4b-4cb3-974e-4bef80f2d1ce None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.037601 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 585/1196] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 10 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:43:20.046254 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a597a-7ad6-44e1-b36f-68fdbc29400a None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.046534 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a597a-7ad6-44e1-b36f-68fdbc29400a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.046813 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a597a-7ad6-44e1-b36f-68fdbc29400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.090166 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-911a597a-7ad6-44e1-b36f-68fdbc29400a None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:20.091395 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-911a597a-7ad6-44e1-b36f-68fdbc29400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:20.184423 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 612/1197] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 10 20:43:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:20.190169 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda1d3-ee61-4e02-9905-739dbd0a7cfe None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.190522 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda1d3-ee61-4e02-9905-739dbd0a7cfe None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.190865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda1d3-ee61-4e02-9905-739dbd0a7cfe None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.192379 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 586/1198] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 10 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:43:20.197383 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a703-9a4e-4760-8575-08be3b1ec60e None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.197865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a703-9a4e-4760-8575-08be3b1ec60e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.198148 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a703-9a4e-4760-8575-08be3b1ec60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.220826 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-7b24a703-9a4e-4760-8575-08be3b1ec60e None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:20.222065 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-7b24a703-9a4e-4760-8575-08be3b1ec60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:20.231413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 613/1199] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 10 20:43:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:20.244665 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda1d3-ee61-4e02-9905-739dbd0a7cfe None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:20.258225 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda1d3-ee61-4e02-9905-739dbd0a7cfe None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:20.264708 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b77f2-bf7b-49fe-8464-36ebe2eaabb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2edea27275f4d75831629f1de22d43d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:20.265565 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b77f2-bf7b-49fe-8464-36ebe2eaabb1 service glance] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.265922 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b77f2-bf7b-49fe-8464-36ebe2eaabb1 service glance] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.266259 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b77f2-bf7b-49fe-8464-36ebe2eaabb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.284732 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b77f2-bf7b-49fe-8464-36ebe2eaabb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:20.286685 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b77f2-bf7b-49fe-8464-36ebe2eaabb1 service glance] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:20.308500 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 587/1200] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:20.658618 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b8c9-5795-4bf8-8cf9-2e2f6eaa0d7a None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.658903 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b8c9-5795-4bf8-8cf9-2e2f6eaa0d7a None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.659172 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b8c9-5795-4bf8-8cf9-2e2f6eaa0d7a None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.660532 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 614/1201] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 10 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:43:20.666035 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb65c7-1502-4d44-8875-203d450783e8 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.666330 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb65c7-1502-4d44-8875-203d450783e8 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.666611 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb65c7-1502-4d44-8875-203d450783e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.687130 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f5bb65c7-1502-4d44-8875-203d450783e8 None None] MFA Rules not processed for user `1ae5691b5c9e45be9a585d5db0ab5cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:20.688343 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f5bb65c7-1502-4d44-8875-203d450783e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:20.743027 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 588/1202] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 10 20:43:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:20.755165 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3b8c9-5795-4bf8-8cf9-2e2f6eaa0d7a None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:20.769666 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3b8c9-5795-4bf8-8cf9-2e2f6eaa0d7a None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:20.773191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422cfb2-a738-43e1-93f7-8463a8e19fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:20.773783 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422cfb2-a738-43e1-93f7-8463a8e19fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:20.774062 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422cfb2-a738-43e1-93f7-8463a8e19fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:20.774332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422cfb2-a738-43e1-93f7-8463a8e19fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:20.781213 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422cfb2-a738-43e1-93f7-8463a8e19fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:20.782638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422cfb2-a738-43e1-93f7-8463a8e19fd7 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:20.790421 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 615/1203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:20 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:21.225661 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b4479-c36a-4791-be88-bd0e40be7860 None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:21.226206 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b4479-c36a-4791-be88-bd0e40be7860 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:21.226292 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b4479-c36a-4791-be88-bd0e40be7860 None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:21.227645 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 589/1204] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 10 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:43:21.237359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46984f2-2162-4527-8aa3-315ebde57ec3 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:21.237643 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46984f2-2162-4527-8aa3-315ebde57ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:21.237917 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46984f2-2162-4527-8aa3-315ebde57ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:21.265248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b4479-c36a-4791-be88-bd0e40be7860 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:21.266975 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-d46984f2-2162-4527-8aa3-315ebde57ec3 None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:21.269021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-d46984f2-2162-4527-8aa3-315ebde57ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:21.281008 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 616/1205] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 10 20:43:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:21.287113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644002-5e79-462d-ba2b-eeffede9ecc6 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:21.289061 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644002-5e79-462d-ba2b-eeffede9ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:21.289589 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=100 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:21.290095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644002-5e79-462d-ba2b-eeffede9ecc6 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:21.294057 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 617/1206] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 10 20:43:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 10 20:43:21.300933 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:21.301212 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:21.301487 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:21.325300 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:21.326689 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:21.336294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 618/1207] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 10 20:43:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:21.347140 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b4479-c36a-4791-be88-bd0e40be7860 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:21.349009 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:21.354129 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:21.355509 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:21.357351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:21.358832 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:21.360420 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e58b35-7440-4200-99b7-d11537dcbf32 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:21.362686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:21.366358 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:21.367671 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:21.367955 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:21.368229 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:21.378076 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:21.381865 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a267-ec21-460e-939d-6b2ca62ade64 service placement] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:21.383555 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:21.388210 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:21.394686 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 590/1208] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:21 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:21.409981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 619/1209] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:43:31.018433 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f05e-cbc9-4775-9e97-6f99ddf6c6ae None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:31.019038 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f05e-cbc9-4775-9e97-6f99ddf6c6ae None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:31.019038 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f05e-cbc9-4775-9e97-6f99ddf6c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:31.043192 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-04e7f05e-cbc9-4775-9e97-6f99ddf6c6ae None None] MFA Rules not processed for user `1ae5691b5c9e45be9a585d5db0ab5cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:31.044862 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-04e7f05e-cbc9-4775-9e97-6f99ddf6c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:31.054632 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 591/1210] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Sep 10 20:43:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:43:31.068293 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:31.077599 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ceb39-8580-4a68-84ed-557b5fd1b968 service neutron] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:31.083398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995b293-b62c-43c6-949d-566624b2552b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:31.083398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b293-b62c-43c6-949d-566624b2552b service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:31.083398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b293-b62c-43c6-949d-566624b2552b service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:31.083398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b293-b62c-43c6-949d-566624b2552b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:31.090038 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b293-b62c-43c6-949d-566624b2552b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:31.091492 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b293-b62c-43c6-949d-566624b2552b service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:31.099884 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 620/1211] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:31 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:31.959731 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eaac1-3bb8-49e4-8b19-50a6b1360cde None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:31.960059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eaac1-3bb8-49e4-8b19-50a6b1360cde None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:31.960389 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eaac1-3bb8-49e4-8b19-50a6b1360cde None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:31.961791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 592/1212] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:43:31.997064 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b222-7ea5-4c1d-a4c4-e329d6af8727 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:31.997373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b222-7ea5-4c1d-a4c4-e329d6af8727 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:31.997670 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b222-7ea5-4c1d-a4c4-e329d6af8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:32.018149 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-4d00b222-7ea5-4c1d-a4c4-e329d6af8727 None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:32.019694 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-4d00b222-7ea5-4c1d-a4c4-e329d6af8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:32.030155 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 621/1213] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:43:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:43:32.077717 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eaac1-3bb8-49e4-8b19-50a6b1360cde None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:32.093712 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eaac1-3bb8-49e4-8b19-50a6b1360cde None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:32.099413 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086a5f2-3235-4a46-84db-e733d3d1be71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:32.100006 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086a5f2-3235-4a46-84db-e733d3d1be71 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:32.100292 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086a5f2-3235-4a46-84db-e733d3d1be71 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:32.100691 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086a5f2-3235-4a46-84db-e733d3d1be71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:32.109622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086a5f2-3235-4a46-84db-e733d3d1be71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:32.111242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086a5f2-3235-4a46-84db-e733d3d1be71 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:32.121507 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 593/1214] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:39.132986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8291b-3556-43c3-b544-456a90d967d8 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:39.133601 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8291b-3556-43c3-b544-456a90d967d8 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:39.133702 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8291b-3556-43c3-b544-456a90d967d8 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:39.135169 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 622/1215] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:43:39.142248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:39.142820 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:39.143016 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:39.164668 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:43:39.165996 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:43:39.176259 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 594/1216] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:43:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:43:39.193341 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8291b-3556-43c3-b544-456a90d967d8 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:39.211015 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8291b-3556-43c3-b544-456a90d967d8 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:39.217243 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935135-f792-4d1e-b066-27a2dac14053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:39.217847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935135-f792-4d1e-b066-27a2dac14053 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:39.218128 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935135-f792-4d1e-b066-27a2dac14053 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:39.218398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935135-f792-4d1e-b066-27a2dac14053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:39.227312 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935135-f792-4d1e-b066-27a2dac14053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:39.228956 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935135-f792-4d1e-b066-27a2dac14053 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:39.239323 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 623/1217] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:43:49.158938 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=35 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:49.235181 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=75 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:43:50.908352 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:43:50.917351 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ad770-5eb3-4698-9bba-ee62a6b87a10 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:43:50.921145 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354369-dcee-40be-b3fe-d971de327816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:43:50.921769 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354369-dcee-40be-b3fe-d971de327816 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:43:50.922050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354369-dcee-40be-b3fe-d971de327816 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:43:50.922323 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354369-dcee-40be-b3fe-d971de327816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:43:50.931370 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8354369-dcee-40be-b3fe-d971de327816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:43:50.932914 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8354369-dcee-40be-b3fe-d971de327816 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:43:50.943011 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 595/1218] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:43:50 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:44:00.938463 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=6 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:44:08.864373 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0d5b-7a04-40d8-bdca-66794eb22e75 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:44:08.864939 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0d5b-7a04-40d8-bdca-66794eb22e75 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:44:08.865043 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0d5b-7a04-40d8-bdca-66794eb22e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:44:08.883346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-540c0d5b-7a04-40d8-bdca-66794eb22e75 None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:44:08.884542 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-540c0d5b-7a04-40d8-bdca-66794eb22e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:44:08.891807 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 624/1219] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:44:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:44:18.878523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:44:31.759620 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8cdd9-0116-4a0d-8d87-8361e5ddbc12 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:44:31.760130 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8cdd9-0116-4a0d-8d87-8361e5ddbc12 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:44:31.760212 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8cdd9-0116-4a0d-8d87-8361e5ddbc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:44:31.778496 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-8db8cdd9-0116-4a0d-8d87-8361e5ddbc12 None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:44:31.779682 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-8db8cdd9-0116-4a0d-8d87-8361e5ddbc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:44:31.786320 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 596/1220] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:44:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:44:41.773791 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:44:44.193272 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa32a6d-8379-47a4-8471-ab415d9ddfef None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:44:44.193742 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa32a6d-8379-47a4-8471-ab415d9ddfef None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:44:44.193847 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa32a6d-8379-47a4-8471-ab415d9ddfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:44:44.213741 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-cfa32a6d-8379-47a4-8471-ab415d9ddfef None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:44:44.214930 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-cfa32a6d-8379-47a4-8471-ab415d9ddfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:44:44.221692 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 625/1221] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:44:44 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:44:54.206865 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=3 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:45:43.043734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:45:43.044247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:45:43.044332 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:45:43.064684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:45:43.066231 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:45:43.077750 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 597/1222] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:45:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:45:43.401793 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:45:43.402288 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:45:43.402372 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:45:43.449802 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] MFA Rules not processed for user `1ae5691b5c9e45be9a585d5db0ab5cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:45:43.451038 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:45:43.467026 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 626/1223] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 10 20:45:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:45:43.478598 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:45:43.487866 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73761aa5-a36b-4d7d-8800-9743a99193ad None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:45:43.491338 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:45:43.491927 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:45:43.492204 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:45:43.492473 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:45:43.499208 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:45:43.501163 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:45:43.508592 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 598/1224] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:45:43 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:45:53.464144 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=17 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:45:53.505386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=9 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:45:56.042359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:45:56.050778 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d8a2-a93b-48c8-9237-dcd7eb3ac5f8 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:45:56.054712 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2fada-4d56-42cd-af3e-a7e941869256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:45:56.055305 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2fada-4d56-42cd-af3e-a7e941869256 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:45:56.055583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2fada-4d56-42cd-af3e-a7e941869256 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:45:56.055854 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2fada-4d56-42cd-af3e-a7e941869256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:45:56.064994 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2fada-4d56-42cd-af3e-a7e941869256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:45:56.066446 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2fada-4d56-42cd-af3e-a7e941869256 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:45:56.075556 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 627/1225] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:45:56 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:46:06.071525 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=6 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:46:22.129391 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:46:22.150810 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e786-c2ea-4c94-92ed-71c94029eaa3 service neutron] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:46:22.155825 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d5e27-7451-4e4a-b845-c8de58490d6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:46:22.156414 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d5e27-7451-4e4a-b845-c8de58490d6d service placement] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:46:22.156696 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d5e27-7451-4e4a-b845-c8de58490d6d service placement] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:46:22.157005 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d5e27-7451-4e4a-b845-c8de58490d6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:46:22.165843 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d5e27-7451-4e4a-b845-c8de58490d6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:46:22.167408 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d5e27-7451-4e4a-b845-c8de58490d6d service placement] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:46:22.176958 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 599/1226] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:46:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:46:32.173104 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=10 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:47:27.833054 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea24a-5bbd-4865-9cc1-28772c10d37e None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:47:27.833472 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea24a-5bbd-4865-9cc1-28772c10d37e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:47:27.833602 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea24a-5bbd-4865-9cc1-28772c10d37e None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:47:27.835113 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 628/1227] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:47:27.840249 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52dad5-304f-40b5-bdd9-5eafa4eea1af None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:47:27.840679 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52dad5-304f-40b5-bdd9-5eafa4eea1af None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:47:27.840847 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52dad5-304f-40b5-bdd9-5eafa4eea1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:47:27.878974 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-ca52dad5-304f-40b5-bdd9-5eafa4eea1af None None] MFA Rules not processed for user `b4ff9eb972fa48f8ad0c32fa56f11fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:47:27.880196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-ca52dad5-304f-40b5-bdd9-5eafa4eea1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:47:27.898938 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 600/1228] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:47:27 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:47:27.913791 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea24a-5bbd-4865-9cc1-28772c10d37e None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:47:27.929095 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea24a-5bbd-4865-9cc1-28772c10d37e None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:47:27.934801 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b243a2-e210-438d-ad96-e2f42c399417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:47:27.935400 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b243a2-e210-438d-ad96-e2f42c399417 service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:47:27.935708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b243a2-e210-438d-ad96-e2f42c399417 service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:47:27.935976 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b243a2-e210-438d-ad96-e2f42c399417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:47:27.944656 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b243a2-e210-438d-ad96-e2f42c399417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:47:27.946237 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b243a2-e210-438d-ad96-e2f42c399417 service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:47:27.956646 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 629/1229] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:47:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:47:37.895806 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=13 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:47:37.953879 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=6 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:47:41.428812 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:47:41.429294 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:47:41.429386 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:47:41.448448 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] MFA Rules not processed for user `4d39d92aa3594305a40dc6c77abc69cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:47:41.449667 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:47:41.456460 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 601/1230] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:47:41 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:47:51.443609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=3 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:06.455705 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:48:06.456218 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:48:06.456388 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:48:06.477176 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:48:06.478509 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:48:06.486430 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 630/1231] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:48:11.306233 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:48:11.320772 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73eb28-2cc2-4a7f-910d-be4a376d3f6c None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:48:11.326029 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:48:11.326659 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:48:11.326935 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:48:11.327377 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:48:11.335622 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:48:11.337452 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:48:11.347319 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 602/1232] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:48:11 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:48:12.074533 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:48:12.086106 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de72f6f-e371-4cc2-bb4c-0b8c47fa2101 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:48:12.091157 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:48:12.091745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:48:12.092022 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:48:12.092294 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:48:12.099714 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:48:12.101317 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:48:12.110346 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 631/1233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:48:12 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:48:21.342758 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=6 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:22.106437 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=9 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:35.284050 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:48:35.287214 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:48:35.294062 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f56ef3-47d0-4481-a0e3-c54dfcffcce7 service nova] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:48:35.296749 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa9cd-e4c6-4fd1-974f-8a39db06f96c service nova] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:48:35.297591 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:48:35.298180 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:48:35.298449 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:48:35.298985 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:48:35.300578 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:48:35.301200 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:48:35.301475 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:48:35.301752 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:48:35.309136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:48:35.309332 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:48:35.310743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:48:35.310867 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:48:35.319391 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 632/1234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:48:35 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:48:35.322357 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 603/1235] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:48:35 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:48:36.615249 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:48:36.629364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dc83-62c9-43d0-9e97-666310928ca2 service neutron] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:48:36.633623 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:48:36.634261 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:48:36.634710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:48:36.634963 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:48:36.644959 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:48:36.646502 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:48:36.657559 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 633/1236] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:48:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 10 20:48:45.316743 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=6 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:46.652727 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=12 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:20.286499 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:20.309913 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdab1d-db2c-4912-9e76-ad4ba4ba533f service neutron] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:20.321560 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07583219-015b-4e77-9fae-11565d692e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:20.322543 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07583219-015b-4e77-9fae-11565d692e6b service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:20.323088 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07583219-015b-4e77-9fae-11565d692e6b service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:20.323572 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07583219-015b-4e77-9fae-11565d692e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:20.335178 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07583219-015b-4e77-9fae-11565d692e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:20.337485 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07583219-015b-4e77-9fae-11565d692e6b service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:20.367104 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 604/1237] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:49:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:49:28.237263 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:28.245648 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402fbea-b73f-4a98-a68e-577e71c8ad35 service neutron] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:28.249181 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496117d2-3f5c-4d05-bf3b-a1686e80bd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:28.249762 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496117d2-3f5c-4d05-bf3b-a1686e80bd52 service neutron] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:28.250034 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496117d2-3f5c-4d05-bf3b-a1686e80bd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:28.250303 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496117d2-3f5c-4d05-bf3b-a1686e80bd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:28.308799 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496117d2-3f5c-4d05-bf3b-a1686e80bd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:28.310233 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496117d2-3f5c-4d05-bf3b-a1686e80bd52 service neutron] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:28.328241 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 634/1238] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:49:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:49:30.345241 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=6 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:31.555648 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b704bdc-27db-4a02-a4ae-d4b4c1fd3e9c None None] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:31.556250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b704bdc-27db-4a02-a4ae-d4b4c1fd3e9c None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:31.556250 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b704bdc-27db-4a02-a4ae-d4b4c1fd3e9c None None] PATH_INFO: `/` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:31.557638 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 605/1239] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:49:31.562875 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:31.563331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:31.563408 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:31.615330 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:49:31.616641 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:49:31.626457 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 635/1240] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:49:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 10 20:49:31.641614 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b704bdc-27db-4a02-a4ae-d4b4c1fd3e9c None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:31.655567 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b704bdc-27db-4a02-a4ae-d4b4c1fd3e9c None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:31.660826 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:31.661999 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:31.662327 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:31.662590 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:31.671191 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:31.673085 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:31.683129 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 606/1241] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:49:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:49:34.688633 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:34.699708 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09499b89-7a93-4ec4-b692-460a74fc3e8e None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:34.704413 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:34.705086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:34.705366 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:34.705638 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] PATH_INFO: `/v3/users/4d39d92aa3594305a40dc6c77abc69cf` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:34.706768 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d39d92aa3594305a40dc6c77abc69cf)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:34.708280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: WARNING py.warnings [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:49:34.708280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: warnings.warn(msg) Sep 10 20:49:34.708280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: Sep 10 20:49:34.709523 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:34.780527 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d39d92aa3594305a40dc6c77abc69cf'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:34.781203 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d39d92aa3594305a40dc6c77abc69cf'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:34.789776 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d39d92aa3594305a40dc6c77abc69cf'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:34.803364 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d39d92aa3594305a40dc6c77abc69cf'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:34.804092 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d39d92aa3594305a40dc6c77abc69cf'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:34.829538 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 636/1242] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 10 20:49:34 2022] DELETE /identity/v3/users/4d39d92aa3594305a40dc6c77abc69cf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 10 20:49:35.013440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:35.024889 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c763105-cc9a-4ba4-a8d9-4bb84f6d0dd8 service placement] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:35.090582 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:35.091202 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:35.091479 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:35.091756 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] PATH_INFO: `/v3/projects/491bef33ceda46298fc983cc5a83aa44` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:35.092873 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] RBAC: Authorizing `identity:delete_project(project_id=491bef33ceda46298fc983cc5a83aa44)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:35.093881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: WARNING py.warnings [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 10 20:49:35.093881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: warnings.warn(msg) Sep 10 20:49:35.093881 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: Sep 10 20:49:35.095059 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:35.149066 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491bef33ceda46298fc983cc5a83aa44', 'request_id': 'req-a360e40e-614b-4e43-a15b-604b54f7251c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.162628 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491bef33ceda46298fc983cc5a83aa44', 'request_id': 'req-a360e40e-614b-4e43-a15b-604b54f7251c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.170154 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491bef33ceda46298fc983cc5a83aa44', 'request_id': 'req-a360e40e-614b-4e43-a15b-604b54f7251c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.182541 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] The token cache is being invalidate because project 491bef33ceda46298fc983cc5a83aa44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 10 20:49:35.182827 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.183448 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.184947 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 607/1243] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 10 20:49:35 2022] DELETE /identity/v3/projects/491bef33ceda46298fc983cc5a83aa44 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:49:35.189223 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:35.190626 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:49:35.203870 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd36ee-f892-422c-890e-b04dec8a077b admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:35.227471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:35.261086 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:35.261710 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:35.261984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:35.262253 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] PATH_INFO: `/v3/users/5ecfa461a8b940a586362d8988787ec1` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:35.263344 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecfa461a8b940a586362d8988787ec1)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:35.265301 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:35.310545 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecfa461a8b940a586362d8988787ec1'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.311184 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecfa461a8b940a586362d8988787ec1'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.318802 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecfa461a8b940a586362d8988787ec1'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.325843 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecfa461a8b940a586362d8988787ec1'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.326491 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-e3d58232-bf9a-4db2-a868-f97ff222fc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecfa461a8b940a586362d8988787ec1'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.343914 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 637/1244] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 10 20:49:35 2022] DELETE /identity/v3/users/5ecfa461a8b940a586362d8988787ec1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:49:35.518324 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:49:35.519940 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:49:35.532761 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360e40e-614b-4e43-a15b-604b54f7251c admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:49:35.589852 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:49:35.590513 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:49:35.590800 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:49:35.591071 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] PATH_INFO: `/v3/projects/8eb24758ee2c4c9088a697fc267dd79a` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:49:35.592179 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb24758ee2c4c9088a697fc267dd79a)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:49:35.594168 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:49:35.614699 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:35.641003 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb24758ee2c4c9088a697fc267dd79a', 'request_id': 'req-e621ed2c-15a9-4201-ad7b-c19f663d04a2'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.646933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb24758ee2c4c9088a697fc267dd79a', 'request_id': 'req-e621ed2c-15a9-4201-ad7b-c19f663d04a2'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.654177 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb24758ee2c4c9088a697fc267dd79a', 'request_id': 'req-e621ed2c-15a9-4201-ad7b-c19f663d04a2'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.664781 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] The token cache is being invalidate because project 8eb24758ee2c4c9088a697fc267dd79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 10 20:49:35.665036 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.665656 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:49:35.667136 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 608/1245] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 10 20:49:35 2022] DELETE /identity/v3/projects/8eb24758ee2c4c9088a697fc267dd79a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:49:45.340407 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:45.661871 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:03.500381 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] REQUEST_METHOD: `POST` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:50:03.500902 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:50:03.500998 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:50:03.519728 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.auth.core [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] MFA Rules not processed for user `055696859261472eae40adbd97fcd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=88337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:50:03.520962 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:03.573196 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 638/1246] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 10 20:50:03 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:50:03.884511 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:50:03.885936 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:03.941621 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ed2c-15a9-4201-ad7b-c19f663d04a2 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:50:03.945111 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:50:03.945705 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:50:03.945987 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:50:03.946260 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:50:03.948062 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:03.957521 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:50:03.958933 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:50:03.966403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 609/1247] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:50:03 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:50:04.398720 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:50:04.400130 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:04.469307 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c890d-3a9d-4314-92d0-9ff2d9e92a7e None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:50:04.474815 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:50:04.475416 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:50:04.475720 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:50:04.475992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:50:04.477698 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:04.489129 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:50:04.490694 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d387-bdbb-42f6-a46b-5a2a5b7c4f15 service placement] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:50:04.500316 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 639/1248] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:50:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:50:13.088684 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:50:13.090255 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:13.162021 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4188ba4-d862-4d5c-8192-b6f3490edaa0 service neutron] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:50:13.167043 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ff9eb972fa48f8ad0c32fa56f11fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:50:13.167675 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:50:13.167959 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:50:13.168234 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:50:13.169996 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:50:13.181934 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:50:13.183515 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f96490-9a97-45b7-b457-bfa1ebc4d390 service nova] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:50:13.193247 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 610/1249] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:50:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:50:14.496225 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=57 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:23.189171 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=58 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:26.065925 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ec14-f63d-491f-98e7-f86dc63fe1a8 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:51:26.067060 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ec14-f63d-491f-98e7-f86dc63fe1a8 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:51:26.067191 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ec14-f63d-491f-98e7-f86dc63fe1a8 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:51:26.068659 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 640/1250] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 10 20:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:51:26.073806 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:51:26.074242 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:51:26.074338 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:51:26.117434 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:51:26.118640 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:51:26.166855 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 611/1251] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 10 20:51:26 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:51:26.174981 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675ec14-f63d-491f-98e7-f86dc63fe1a8 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:51:26.190471 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675ec14-f63d-491f-98e7-f86dc63fe1a8 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:51:26.196081 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:51:26.196671 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:51:26.196986 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:51:26.197259 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:51:26.198972 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:51:26.210900 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:51:26.212470 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e23b2-78bb-4e4d-a178-0e239e48419d service placement] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:51:26.221889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 641/1252] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:51:26 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:51:36.164647 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=29 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:36.217949 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=6 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:38.203144 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:52:38.204558 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:52:38.215505 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc291300-3832-4783-b511-dff70fb8a9e4 None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:52:38.218944 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae5691b5c9e45be9a585d5db0ab5cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:52:38.219526 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:38.219803 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:38.220074 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:38.221731 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:52:38.304573 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:52:38.306040 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cb446-253d-4fd6-9ed8-5e80e1fcdb39 service neutron] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:52:38.315604 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 612/1253] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:52:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:52:41.224810 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824cff1-7527-4fd6-b230-6357112c26c6 None None] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:41.225280 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824cff1-7527-4fd6-b230-6357112c26c6 None None] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:41.225518 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824cff1-7527-4fd6-b230-6357112c26c6 None None] PATH_INFO: `/` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:41.226942 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 642/1254] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 10 20:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 10 20:52:41.237582 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] REQUEST_METHOD: `POST` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:41.238018 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:41.238326 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:41.260339 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.auth.core [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] MFA Rules not processed for user `f16498f5c9ce4b8aa7192f492d387ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=88336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 10 20:52:41.261734 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:52:41.271065 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 613/1255] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 10 20:52:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 10 20:52:41.447359 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824cff1-7527-4fd6-b230-6357112c26c6 None None] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:52:41.463398 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824cff1-7527-4fd6-b230-6357112c26c6 None None] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:52:41.474909 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:52:41.475500 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] REQUEST_METHOD: `GET` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:41.475745 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:41.476044 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:41.484720 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:52:41.486425 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:52:41.495898 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 643/1256] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:52:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:52:44.614248 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:52:44.615780 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:52:44.629720 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa26fa-3e9d-46cc-bab7-60e42e734d5a None None] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:52:44.634896 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:52:44.635172 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:44.635491 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:44.635771 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] PATH_INFO: `/v3/users/055696859261472eae40adbd97fcd20c` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:44.636932 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055696859261472eae40adbd97fcd20c)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:52:44.639422 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:52:44.688518 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055696859261472eae40adbd97fcd20c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:44.689194 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055696859261472eae40adbd97fcd20c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:44.696608 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055696859261472eae40adbd97fcd20c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:44.697302 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055696859261472eae40adbd97fcd20c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:44.711196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055696859261472eae40adbd97fcd20c'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:44.724224 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 614/1257] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 10 20:52:44 2022] DELETE /identity/v3/users/055696859261472eae40adbd97fcd20c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:52:44.906171 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:52:44.916894 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010088bc-c51b-4e26-bfd0-f6a4b29969bd service placement] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:52:44.974734 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:52:44.975356 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:44.975634 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:44.975909 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] PATH_INFO: `/v3/projects/9d44d875c1b04e9f847fec2f5a5cd958` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:44.977059 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d44d875c1b04e9f847fec2f5a5cd958)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:52:44.978992 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:52:45.024242 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d44d875c1b04e9f847fec2f5a5cd958', 'request_id': 'req-271a628a-3181-4868-8586-540f51df7b60'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.030432 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d44d875c1b04e9f847fec2f5a5cd958', 'request_id': 'req-271a628a-3181-4868-8586-540f51df7b60'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.037887 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d44d875c1b04e9f847fec2f5a5cd958', 'request_id': 'req-271a628a-3181-4868-8586-540f51df7b60'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.048563 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] The token cache is being invalidate because project 9d44d875c1b04e9f847fec2f5a5cd958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 10 20:52:45.048889 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.049511 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.051021 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 644/1258] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 10 20:52:44 2022] DELETE /identity/v3/projects/9d44d875c1b04e9f847fec2f5a5cd958 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:52:45.055196 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:52:45.056605 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:52:45.069813 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dc042-a6ba-4072-9980-c4cfd05cc250 admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:52:45.107304 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:45.126218 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:52:45.126834 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:45.127115 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:45.127388 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] PATH_INFO: `/v3/users/0a9cef3a2e2947bdbfe8097d1538107f` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:45.128479 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9cef3a2e2947bdbfe8097d1538107f)` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:52:45.130456 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:52:45.179176 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9cef3a2e2947bdbfe8097d1538107f'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.179720 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9cef3a2e2947bdbfe8097d1538107f'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.187403 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9cef3a2e2947bdbfe8097d1538107f'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.188022 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9cef3a2e2947bdbfe8097d1538107f'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.201041 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.notifications [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9cef3a2e2947bdbfe8097d1538107f'} {{(pid=88336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.212754 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 615/1259] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 10 20:52:45 2022] DELETE /identity/v3/users/0a9cef3a2e2947bdbfe8097d1538107f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:52:45.385583 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Authenticating user token {{(pid=88337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:52:45.387036 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.fernet_utils [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:52:45.401739 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a628a-3181-4868-8586-540f51df7b60 admin admin] Validating token access rules against request {{(pid=88337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:52:45.458805 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4896c73f97d94602afe7ed8c9d748471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b9411a439646919a95885e1ed2dcbc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:52:45.459331 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:52:45.459606 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] SCRIPT_NAME: `/identity` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:52:45.459874 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] PATH_INFO: `/v3/projects/d2893eee1a864fb88f3749062308703b` {{(pid=88337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:52:45.460984 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2893eee1a864fb88f3749062308703b)` {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:52:45.462912 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] RBAC: Authorization granted {{(pid=88337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:52:45.483987 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:45.510070 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2893eee1a864fb88f3749062308703b', 'request_id': 'req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.516194 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2893eee1a864fb88f3749062308703b', 'request_id': 'req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.524112 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2893eee1a864fb88f3749062308703b', 'request_id': 'req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b'} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.537810 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] The token cache is being invalidate because project d2893eee1a864fb88f3749062308703b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 10 20:52:45.538264 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.538977 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG keystone.notifications [None req-c38dfa49-5cd8-4c5d-9a34-f20e2504548b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 10 20:52:45.541013 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: [pid: 88337|app: 0|req: 645/1260] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 10 20:52:45 2022] DELETE /identity/v3/projects/d2893eee1a864fb88f3749062308703b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 10 20:52:55.209426 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:55.532324 dv-osbrick-master-4-ceph devstack@keystone.service[88337]: DEBUG dbcounter [-] [88337] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:31.094317 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Authenticating user token {{(pid=88336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 10 20:56:31.095721 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:56:31.182077 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3a7da-65f0-4b22-8cd6-997aac6e26cc admin admin] Validating token access rules against request {{(pid=88336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 10 20:56:31.240761 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f16498f5c9ce4b8aa7192f492d387ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890e5386cd904d8abe3df34e12e047f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 10 20:56:31.241329 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] REQUEST_METHOD: `GET` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 10 20:56:31.241609 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] SCRIPT_NAME: `/identity` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 10 20:56:31.241887 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 10 20:56:31.243599 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.fernet_utils [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 10 20:56:31.254440 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 10 20:56:31.256564 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb8731-bb34-49f4-8e20-64a979bb547a service placement] RBAC: Authorization granted {{(pid=88336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 10 20:56:31.266181 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: [pid: 88336|app: 0|req: 616/1261] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 10 20:56:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 10 20:56:41.262094 dv-osbrick-master-4-ceph devstack@keystone.service[88336]: DEBUG dbcounter [-] [88336] Writing DB stats keystone:SELECT=62 {{(pid=88336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}